SajjadAyoubi/distil-feature-as-text

base model: 'HooshvareLab/distilbert-fa-zwnj-base'

• trained for 2 epochs with 256 as max_length
• 3x faster than the Bert model despite having the same performance

model performance on test:

{'eval_loss': 0.3385954797267914,
 'eval_roc_auc': 0.9378028883850424,
 'eval_f1_score': 0.8662723907586265,
 'eval_recall': 0.8818815783774419,
 'eval_percision': 0.8512061541034324,
 'eval_runtime': 204.8524,
 'eval_samples_per_second': 229.609,
 'eval_steps_per_second': 7.176,
 'epoch': 2.0}