arad1367 commited on
Commit
e13c750
·
verified ·
1 Parent(s): 3bd0f34

Model save

Browse files
README.md CHANGED
@@ -35,16 +35,16 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 0.0001
39
  - train_batch_size: 4
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - gradient_accumulation_steps: 8
43
  - total_train_batch_size: 32
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
- - lr_scheduler_type: cosine
46
- - lr_scheduler_warmup_ratio: 0.05
47
- - num_epochs: 5
48
 
49
  ### Training results
50
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 0.0002
39
  - train_batch_size: 4
40
  - eval_batch_size: 8
41
  - seed: 42
42
  - gradient_accumulation_steps: 8
43
  - total_train_batch_size: 32
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
+ - lr_scheduler_type: constant
46
+ - lr_scheduler_warmup_ratio: 0.03
47
+ - num_epochs: 3
48
 
49
  ### Training results
50
 
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e259587b7aaedbef784918ce5bf1828561588032b19e82a69570d57514ff879c
3
  size 4372840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ebaa7eb4194e32b6e7fdae6471e2bb00a3bf82bc3f535315db003338cdd454a3
3
  size 4372840
runs/Dec27_17-39-37_joserv2/events.out.tfevents.1735321186.joserv2.3936325.6 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5b1c47879ee09a4a8ffa6e6b0b35db9bf83ca01a152fcae08af52d4b35090d89
3
- size 11752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f35e2a27e64ac914995c3ec257e0a34393615af8ba4173dd5b09461493e748b4
3
+ size 14849