beamaia commited on
Commit
753c678
1 Parent(s): 90cf7fd

Model save

Browse files
Files changed (1) hide show
  1. README.md +72 -0
README.md ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: peft
4
+ tags:
5
+ - trl
6
+ - kto
7
+ - generated_from_trainer
8
+ base_model: HuggingFaceH4/zephyr-7b-beta
9
+ model-index:
10
+ - name: WeniGPT-Agents-Zephyr-1.0.9-KTO
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # WeniGPT-Agents-Zephyr-1.0.9-KTO
18
+
19
+ This model is a fine-tuned version of [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) on the None dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 0.5443
22
+ - Rewards/chosen: -130.8165
23
+ - Logps/chosen: -1605.7635
24
+ - Rewards/rejected: -121.0086
25
+ - Logps/rejected: -1472.8949
26
+ - Kl: 0.0
27
+ - Rewards/margins: -16.2952
28
+
29
+ ## Model description
30
+
31
+ More information needed
32
+
33
+ ## Intended uses & limitations
34
+
35
+ More information needed
36
+
37
+ ## Training and evaluation data
38
+
39
+ More information needed
40
+
41
+ ## Training procedure
42
+
43
+ ### Training hyperparameters
44
+
45
+ The following hyperparameters were used during training:
46
+ - learning_rate: 0.0002
47
+ - train_batch_size: 4
48
+ - eval_batch_size: 4
49
+ - seed: 42
50
+ - gradient_accumulation_steps: 4
51
+ - total_train_batch_size: 16
52
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
53
+ - lr_scheduler_type: linear
54
+ - lr_scheduler_warmup_ratio: 0.03
55
+ - training_steps: 145
56
+ - mixed_precision_training: Native AMP
57
+
58
+ ### Training results
59
+
60
+ | Training Loss | Epoch | Step | Validation Loss | Rewards/chosen | Logps/chosen | Rewards/rejected | Logps/rejected | Kl | Rewards/margins |
61
+ |:-------------:|:-----:|:----:|:---------------:|:--------------:|:------------:|:----------------:|:--------------:|:---:|:---------------:|
62
+ | 0.4555 | 0.34 | 50 | 0.5443 | -148.8861 | -1786.4595 | -135.3632 | -1616.4402 | 0.0 | -20.0430 |
63
+ | 0.5714 | 0.68 | 100 | 0.5443 | -130.8165 | -1605.7635 | -121.0086 | -1472.8949 | 0.0 | -16.2952 |
64
+
65
+
66
+ ### Framework versions
67
+
68
+ - PEFT 0.10.0
69
+ - Transformers 4.39.1
70
+ - Pytorch 2.1.0+cu118
71
+ - Datasets 2.18.0
72
+ - Tokenizers 0.15.2