Hugging Face's logo

lole25
/
zephyr-7b-gpo-v7-i1

PEFT
TensorBoard
Safetensors
mistral
alignment-handbook
Generated from Trainer
trl
dpo
Model card Files Metrics Community
lole25 commited on
Commit
8bc088e
•
1 Parent(s): 036c0a2

Model save

Browse files
Files changed (11) hide show
  1. README.md +60 -0
  2. adapter_config.json +5 -5
  3. adapter_model.safetensors +1 -1
  4. all_results.json +8 -0
  5. runs/May08_06-58-17_gpu4-119-5/events.out.tfevents.1715115552.gpu4-119-5.3977414.0 +2 -2
  6. runs/May08_16-00-04_gpu4-119-5/events.out.tfevents.1715148072.gpu4-119-5.184026.0 +3 -0
  7. runs/May08_16-04-55_gpu4-119-5/events.out.tfevents.1715148367.gpu4-119-5.189970.0 +3 -0
  8. runs/May08_16-10-42_gpu4-119-5/events.out.tfevents.1715148720.gpu4-119-5.197226.0 +3 -0
  9. train_results.json +8 -0
  10. trainer_state.json +0 -0
  11. training_args.bin +1 -1
README.md ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: peft
4
+ tags:
5
+ - trl
6
+ - dpo
7
+ - generated_from_trainer
8
+ base_model: DUAL-GPO/zephyr-7b-gpo-final-i0
9
+ model-index:
10
+ - name: zephyr-7b-gpo-v7-i1
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # zephyr-7b-gpo-v7-i1
18
+
19
+ This model is a fine-tuned version of [DUAL-GPO/zephyr-7b-gpo-final-i0](https://huggingface.co/DUAL-GPO/zephyr-7b-gpo-final-i0) on the None dataset.
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 5e-06
39
+ - train_batch_size: 2
40
+ - eval_batch_size: 2
41
+ - seed: 42
42
+ - distributed_type: multi-GPU
43
+ - gradient_accumulation_steps: 2
44
+ - total_train_batch_size: 4
45
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
+ - lr_scheduler_type: cosine
47
+ - lr_scheduler_warmup_ratio: 0.1
48
+ - num_epochs: 0.88
49
+
50
+ ### Training results
51
+
52
+
53
+
54
+ ### Framework versions
55
+
56
+ - PEFT 0.7.1
57
+ - Transformers 4.36.2
58
+ - Pytorch 2.1.2+cu121
59
+ - Datasets 2.14.6
60
+ - Tokenizers 0.15.2
adapter_config.json CHANGED
@@ -19,13 +19,13 @@
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
22
- "gate_proj",
23
- "up_proj",
24
- "o_proj",
25
  "k_proj",
26
- "q_proj",
 
27
  "v_proj",
28
- "down_proj"
 
 
29
  ],
30
  "task_type": "CAUSAL_LM"
31
  }
 
19
  "rank_pattern": {},
20
  "revision": null,
21
  "target_modules": [
 
 
 
22
  "k_proj",
23
+ "down_proj",
24
+ "up_proj",
25
  "v_proj",
26
+ "o_proj",
27
+ "gate_proj",
28
+ "q_proj"
29
  ],
30
  "task_type": "CAUSAL_LM"
31
  }
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:281b9421331c73fa57fa7ac9088efd80895a067fee3f8bfcd52a3ffd7c9bf20f
3
  size 671150064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cf52b4a6ea0c732f37faa2afd186b91f405842cef164641967b68e1dc84e52f
3
  size 671150064
all_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.9,
3
+ "train_loss": 2.6126050373789884e-05,
4
+ "train_runtime": 6.3979,
5
+ "train_samples": 33340,
6
+ "train_samples_per_second": 4585.774,
7
+ "train_steps_per_second": 1146.475
8
+ }
runs/May08_06-58-17_gpu4-119-5/events.out.tfevents.1715115552.gpu4-119-5.3977414.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fae075a938b38c5194f04c5e0fbd57f6465f53e672feae0e1a480159e62896c1
3
- size 474210
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc1fa9dd684440f1137c1b034d83ac47d58121bfb7395530a48de1cfbd2d008b
3
+ size 481184
runs/May08_16-00-04_gpu4-119-5/events.out.tfevents.1715148072.gpu4-119-5.184026.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10f2026fee2dd4458d491ba0b0954d4ceae5885cbb0780d209f8a58eacee5830
3
+ size 4559
runs/May08_16-04-55_gpu4-119-5/events.out.tfevents.1715148367.gpu4-119-5.189970.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c8f210f7e08b9bb75a57e96df66aa7f408908d1b78de22f036742dc7ab70aa5
3
+ size 4562
runs/May08_16-10-42_gpu4-119-5/events.out.tfevents.1715148720.gpu4-119-5.197226.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2a82309d6d306fd2d36636f810d8db9fe3d68c125419e2506b28daf93100cce
3
+ size 4916
train_results.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 0.9,
3
+ "train_loss": 2.6126050373789884e-05,
4
+ "train_runtime": 6.3979,
5
+ "train_samples": 33340,
6
+ "train_samples_per_second": 4585.774,
7
+ "train_steps_per_second": 1146.475
8
+ }
trainer_state.json ADDED
The diff for this file is too large to render. See raw diff
 
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:93ed187ecb9bc20e1a5cb550cdaaa1b1ce21c0905772d2f54c5e5f8326fb06a0
3
  size 5816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10125fe2c4f72145462296fbba8c1247800b0fee68fd380919b799d86148576e
3
  size 5816