File size: 2,337 Bytes
b220cef | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 | # microsoft/codebert-base Script Detector
## Summary
| Field | Value |
| --- | --- |
| Base model | `microsoft/codebert-base` |
| Phase | `phase1` |
| Target repo | `HID-APP/script-detector-microsoft-codebert-base` |
| Datasets | `HID-APP/All-combined` |
| Text column | `text` |
| Epochs | 3.0000 |
| Max length | 512 |
| Train batch size | 4 |
| Eval batch size | 8 |
| Gradient accumulation steps | 4 |
| Learning rate | 0.0000 |
| Precision | fp16 |
| Optimizer | adamw_torch |
| Dataloader workers | 0 |
| Gradient checkpointing | False |
| Group by length | True |
| LoRA enabled | False |
## Dataset Sources
| Source | Type | Revision | Fingerprint |
| --- | --- | --- | --- |
| HID-APP/All-combined | huggingface | default | 81f16d3fdbb4f97d3574f5c78bce8ada7b15c9ccd625913daa095cae6d545d67 |
## Training And Validation History
| Epoch | Step | Train Loss | Eval Loss | Accuracy | Precision | Recall | F1 |
| --- | --- | --- | --- | --- | --- | --- | --- |
| 1.0000 | 373 | 3.2531 | | | | | |
| 1.0000 | 373 | | 0.5277 | 0.8353 | 0.8144 | 0.9806 | 0.8898 |
| 2.0000 | 746 | 2.7352 | | | | | |
| 2.0000 | 746 | | 0.5214 | 0.8291 | 0.8015 | 0.9943 | 0.8875 |
| 3.0000 | 1119 | 2.6190 | | | | | |
| 3.0000 | 1119 | | 0.5194 | 0.8360 | 0.8383 | 0.9396 | 0.8860 |
## Final Test Summary
| Split | Accuracy | Malicious Precision | Malicious Recall | Malicious F1 | Loss |
| --- | --- | --- | --- | --- | --- |
| test | 0.7846 | 0.7636 | 0.9598 | 0.8505 | 0.7020 |
## Final Test Classification Report
| Class | Precision | Recall | F1 | Support |
| --- | --- | --- | --- | --- |
| benign | 0.8701 | 0.4753 | 0.6147 | 465.0000 |
| malicious | 0.7636 | 0.9598 | 0.8505 | 821.0000 |
| macro avg | 0.8168 | 0.7175 | 0.7326 | 1286.0000 |
| weighted avg | 0.8021 | 0.7846 | 0.7653 | 1286.0000 |
| accuracy | | | 0.7846 | |
## Final Test Confusion Matrix
| | Pred benign | Pred malicious |
| --- | --- | --- |
| Actual benign | 221 | 244 |
| Actual malicious | 33 | 788 |
## Final Test Grouped By Original Sample
Chunk rows: `1286`; original samples: `1286`.
| Pooling | Original Samples | Accuracy | Malicious Precision | Malicious Recall | Malicious F1 |
| --- | --- | --- | --- | --- | --- |
| max_pool | 1286 | 0.7846 | 0.7636 | 0.9598 | 0.8505 |
| mean_pool | 1286 | 0.7846 | 0.7636 | 0.9598 | 0.8505 |
|