End of training
Browse files- README.md +10 -2
- model-00001-of-00003.safetensors +1 -1
- model-00002-of-00003.safetensors +1 -1
- model-00003-of-00003.safetensors +1 -1
README.md
CHANGED
@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
|
15 |
This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
-
- Loss:
|
18 |
|
19 |
## Model description
|
20 |
|
@@ -44,7 +44,7 @@ The following hyperparameters were used during training:
|
|
44 |
- total_eval_batch_size: 4
|
45 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
46 |
- lr_scheduler_type: linear
|
47 |
-
- training_steps:
|
48 |
|
49 |
### Training results
|
50 |
|
@@ -58,6 +58,14 @@ The following hyperparameters were used during training:
|
|
58 |
| 4.1435 | 0.05 | 150 | 4.2747 |
|
59 |
| 3.7831 | 0.06 | 175 | 3.9269 |
|
60 |
| 3.6802 | 0.06 | 200 | 3.6937 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
61 |
|
62 |
|
63 |
### Framework versions
|
|
|
14 |
|
15 |
This model is a fine-tuned version of [meta-llama/Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b-hf) on the None dataset.
|
16 |
It achieves the following results on the evaluation set:
|
17 |
+
- Loss: 2.8945
|
18 |
|
19 |
## Model description
|
20 |
|
|
|
44 |
- total_eval_batch_size: 4
|
45 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
46 |
- lr_scheduler_type: linear
|
47 |
+
- training_steps: 400
|
48 |
|
49 |
### Training results
|
50 |
|
|
|
58 |
| 4.1435 | 0.05 | 150 | 4.2747 |
|
59 |
| 3.7831 | 0.06 | 175 | 3.9269 |
|
60 |
| 3.6802 | 0.06 | 200 | 3.6937 |
|
61 |
+
| 3.5049 | 0.07 | 225 | 3.5292 |
|
62 |
+
| 3.3127 | 0.08 | 250 | 3.4086 |
|
63 |
+
| 3.1939 | 0.09 | 275 | 3.3188 |
|
64 |
+
| 3.149 | 0.1 | 300 | 3.2472 |
|
65 |
+
| 3.0679 | 0.1 | 325 | 3.1902 |
|
66 |
+
| 3.0111 | 0.11 | 350 | 3.1422 |
|
67 |
+
| 2.9573 | 0.12 | 375 | 3.1011 |
|
68 |
+
| 3.0001 | 0.13 | 400 | 3.0645 |
|
69 |
|
70 |
|
71 |
### Framework versions
|
model-00001-of-00003.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4938985352
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b73162e13a5e2c2386aa25b3543102189603f743cf99982616d6d970a19f7e51
|
3 |
size 4938985352
|
model-00002-of-00003.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 4947390880
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:41db403d325851edb5854dcec94dfd3bdb4029ec248e6069a5fda5232dc15558
|
3 |
size 4947390880
|
model-00003-of-00003.safetensors
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 3590488816
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f6598cd112b175203ce0ef341271e819da23cf75eca4fb975d967b36601313d9
|
3 |
size 3590488816
|