sivan22's picture
Update README.md
1d84d21
metadata
license: apache-2.0
base_model: dicta-il/BEREL_2.0
tags:
  - generated_from_trainer
metrics:
  - accuracy
model-index:
  - name: shulchan_aruch_classifier
    results: []

This model is a fine-tuned version of dicta-il/BEREL_2.0 on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.1927
  • Accuracy: 0.9507

Model description

诪讜讚诇 讝讛 诪拽讘诇 讻诇 诪砖驻讟 讜诪住讜讜讙 讗讜转讜 诇讗讞转 讛拽讟讙讜专讬讜转 讛讘讗讜转: 讗讜专讞 讞讬讬诐, 讞讜砖谉 诪砖驻讟 讗讜 讬讜专讛 讚注讛.

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • train_batch_size: 16
  • eval_batch_size: 16
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 2

Training results

Training Loss Epoch Step Validation Loss Accuracy
0.2694 1.0 537 0.1761 0.9409
0.0922 2.0 1074 0.1927 0.9507

Framework versions

  • Transformers 4.33.0
  • Pytorch 2.0.0
  • Datasets 2.1.0
  • Tokenizers 0.13.3