notesum.ai
Published at November 12SecEncoder: Logs are All You Need in Security
cs.CR
cs.AI
cs.CL
cs.LG
Released Date: November 12, 2024
Authors: Muhammed Fatih Bulut1, Yingqi Liu1, Naveed Ahmad1, Maximilian Turner1, Sami Ait Ouahmane1, Cameron Andrews1, Lloyd Greenwald1
Aff.: 1Microsoft Security AI Research
| SecEncoder | NL-based models | |||||
| Base | Large | xLarge | xxLarge | BERT-large | DeBERTa-v3 large | |
| Structured-windows | 1 | 1 | 1 | 1 | 1 | 1 |
| Unstructured-syslogs | 0.34 | 0.38 | 0.39 | 0.36 | 0.38 | 0.18 |
| M365 | 0.86 | 0.91 | 0.81 | 0.73 | 0.90 | 0.18 |
| F5 syslogs | 0.82 | 0.84 | 0.84 | 0.84 | 0.84 | 0.81 |
| HDFS | 1.00 | 1.00 | 1.00 | 1.00 | 0.98 | 0.98 |
| BGL | 0.95 | 0.98 | 0.98 | 0.98 | 0.29 | 0.58 |
| ThunderBird | 0.79 | 0.69 | 0.84 | 0.82 | 0.87 | 0.78 |
| Avg | 0.82 | 0.83 | 0.84 | 0.82 | 0.75 | 0.64 |