llm-wizard commited on
Commit
2012c4e
1 Parent(s): 4732c14

Model save

Browse files
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- license: other
3
  library_name: peft
4
  tags:
5
  - trl
@@ -38,15 +38,15 @@ More information needed
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0002
41
- - train_batch_size: 2
42
  - eval_batch_size: 8
43
  - seed: 42
44
  - gradient_accumulation_steps: 2
45
- - total_train_batch_size: 4
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: constant
48
  - lr_scheduler_warmup_ratio: 0.03
49
- - num_epochs: 4
50
  - mixed_precision_training: Native AMP
51
 
52
  ### Training results
@@ -56,7 +56,7 @@ The following hyperparameters were used during training:
56
  ### Framework versions
57
 
58
  - PEFT 0.10.0
59
- - Transformers 4.40.1
60
  - Pytorch 2.2.1+cu121
61
- - Datasets 2.19.0
62
  - Tokenizers 0.19.1
 
1
  ---
2
+ license: llama3
3
  library_name: peft
4
  tags:
5
  - trl
 
38
 
39
  The following hyperparameters were used during training:
40
  - learning_rate: 0.0002
41
+ - train_batch_size: 4
42
  - eval_batch_size: 8
43
  - seed: 42
44
  - gradient_accumulation_steps: 2
45
+ - total_train_batch_size: 8
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: constant
48
  - lr_scheduler_warmup_ratio: 0.03
49
+ - num_epochs: 6
50
  - mixed_precision_training: Native AMP
51
 
52
  ### Training results
 
56
  ### Framework versions
57
 
58
  - PEFT 0.10.0
59
+ - Transformers 4.40.2
60
  - Pytorch 2.2.1+cu121
61
+ - Datasets 2.19.1
62
  - Tokenizers 0.19.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d558c1ff7b26fa74c52caffe447bfdd52cc0679f255efb8a0ef50f3bae13438c
3
  size 335604696
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:61e127b8f2fbc3f09cf93cbb57b265e8bd1b888d1d36d776db893ee415d08afd
3
  size 335604696
runs/May14_20-54-51_bbbbad40dc7c/events.out.tfevents.1715720096.bbbbad40dc7c.3181.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cf788fb39c753d0a8d3201167514f2fc2383e3099c277c2ae8cb11cf5e436e8b
3
- size 4184
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:731f9dc1fff89195890ef766903ed50c3c4b451d18300b675d7b5117bee943d0
3
+ size 5607