Hugging Face's logo

Menouar
/
falcon7b-linear-equations

PEFT
TensorBoard
Safetensors
Transformers
English
trl
sft
Generated from Trainer
falcon
Model card Files Metrics Community
Menouar commited on
Commit
8a83499
•
1 Parent(s): b86d4f6

Model save

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -36,15 +36,15 @@ More information needed
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 0.0002
39
- - train_batch_size: 25
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - gradient_accumulation_steps: 2
43
- - total_train_batch_size: 50
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: constant
46
  - lr_scheduler_warmup_ratio: 0.03
47
- - training_steps: 800
48
 
49
  ### Training results
50
 
 
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 0.0002
39
+ - train_batch_size: 40
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - gradient_accumulation_steps: 2
43
+ - total_train_batch_size: 80
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: constant
46
  - lr_scheduler_warmup_ratio: 0.03
47
+ - training_steps: 1600
48
 
49
  ### Training results
50