Commit
•
b3d2876
1
Parent(s):
729735e
End of training
Browse files- README.md +29 -1
- adapter_model.bin +3 -0
README.md
CHANGED
|
@@ -1,6 +1,7 @@
|
|
| 1 |
---
|
| 2 |
library_name: peft
|
| 3 |
tags:
|
|
|
|
| 4 |
- generated_from_trainer
|
| 5 |
base_model: meta-llama/Llama-2-7b-hf
|
| 6 |
model-index:
|
|
@@ -94,7 +95,9 @@ special_tokens:
|
|
| 94 |
|
| 95 |
# logic_magazine_jsonl
|
| 96 |
|
| 97 |
-
This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on
|
|
|
|
|
|
|
| 98 |
|
| 99 |
## Model description
|
| 100 |
|
|
@@ -140,6 +143,31 @@ The following hyperparameters were used during training:
|
|
| 140 |
- lr_scheduler_warmup_steps: 10
|
| 141 |
- num_epochs: 3
|
| 142 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 143 |
### Framework versions
|
| 144 |
|
| 145 |
- PEFT 0.7.0
|
|
|
|
| 1 |
---
|
| 2 |
library_name: peft
|
| 3 |
tags:
|
| 4 |
+
- axolotl
|
| 5 |
- generated_from_trainer
|
| 6 |
base_model: meta-llama/Llama-2-7b-hf
|
| 7 |
model-index:
|
|
|
|
| 95 |
|
| 96 |
# logic_magazine_jsonl
|
| 97 |
|
| 98 |
+
This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
|
| 99 |
+
It achieves the following results on the evaluation set:
|
| 100 |
+
- Loss: 2.3642
|
| 101 |
|
| 102 |
## Model description
|
| 103 |
|
|
|
|
| 143 |
- lr_scheduler_warmup_steps: 10
|
| 144 |
- num_epochs: 3
|
| 145 |
|
| 146 |
+
### Training results
|
| 147 |
+
|
| 148 |
+
| Training Loss | Epoch | Step | Validation Loss |
|
| 149 |
+
|:-------------:|:-----:|:----:|:---------------:|
|
| 150 |
+
| 2.3553 | 0.15 | 20 | 2.4167 |
|
| 151 |
+
| 2.2767 | 0.31 | 40 | 2.3869 |
|
| 152 |
+
| 2.2854 | 0.46 | 60 | 2.3658 |
|
| 153 |
+
| 2.2849 | 0.61 | 80 | 2.3470 |
|
| 154 |
+
| 2.353 | 0.76 | 100 | 2.3337 |
|
| 155 |
+
| 2.2412 | 0.92 | 120 | 2.3363 |
|
| 156 |
+
| 2.1992 | 1.07 | 140 | 2.3240 |
|
| 157 |
+
| 2.1069 | 1.22 | 160 | 2.3404 |
|
| 158 |
+
| 2.2444 | 1.37 | 180 | 2.3403 |
|
| 159 |
+
| 2.1424 | 1.53 | 200 | 2.3446 |
|
| 160 |
+
| 2.1739 | 1.68 | 220 | 2.3404 |
|
| 161 |
+
| 2.1423 | 1.83 | 240 | 2.3382 |
|
| 162 |
+
| 2.1721 | 1.98 | 260 | 2.3378 |
|
| 163 |
+
| 2.1621 | 2.14 | 280 | 2.3630 |
|
| 164 |
+
| 2.0394 | 2.29 | 300 | 2.3623 |
|
| 165 |
+
| 2.0631 | 2.44 | 320 | 2.3665 |
|
| 166 |
+
| 2.0234 | 2.6 | 340 | 2.3632 |
|
| 167 |
+
| 2.1042 | 2.75 | 360 | 2.3654 |
|
| 168 |
+
| 2.02 | 2.9 | 380 | 2.3642 |
|
| 169 |
+
|
| 170 |
+
|
| 171 |
### Framework versions
|
| 172 |
|
| 173 |
- PEFT 0.7.0
|
adapter_model.bin
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5dc6cf2c900a423ac47ac5cfde6579178bc9450079a79884cbb18621301dbe45
|
| 3 |
+
size 319977229
|