idps-escape

Data cleaning

Once a detector is created, numerous files are created as explained here, more so if the data shipping is enabled detector data streams and templates are created too.

At some point, this data may not be useful anymore. Hence, we offer an interactive procedure for removing them:

sudo poetry run python siem_mtad_gat/data_cleaner.py

The option to remove all actually removes all detectors except those listed in KEEP_DETECTORS in siem_mtad_gat/settings.py.

Data cleaner flow

graph TB
    S[/Start/] --> B{Remove a specific detector?}
    B -- Yes --> C[Get ID]
    C --> D[Remove detector's folder]
    D --> F{Remove corresponding detector stream?}
    F -- Yes --> G[Remove detector stream]
    F -- No --> E[Exit]
    G --> E
    B -- No --> A{Do you want to remove all detectors?}
    A -- No --> E[Exit]
    A -- Yes --> H[Remove all]
    H --> I{Do you want to remove the corresponding detector streams?}
    I -- No --> E[/Exit/]
    I -- Yes --> L[Remove all]
    L --> E