File size: 497 Bytes
b80fd18 8bd52d2 b80fd18 5b1f5f1 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 |
base model: 'HooshvareLab/distilbert-fa-zwnj-base'
- trained for 2 epochs with 256 as max_length
- 3x faster than the Bert model despite having the same performance
model performance on test:
```
{'eval_loss': 0.3385954797267914,
'eval_roc_auc': 0.9378028883850424,
'eval_f1_score': 0.8662723907586265,
'eval_recall': 0.8818815783774419,
'eval_percision': 0.8512061541034324,
'eval_runtime': 204.8524,
'eval_samples_per_second': 229.609,
'eval_steps_per_second': 7.176,
'epoch': 2.0}
``` |