Hugging Face's logo

thrunlab
/
Mistral_Sparse_refined_web_50p_2024-03-10

Text Generation
Transformers
Safetensors
sparse_mistral
Generated from Trainer
custom_code
Model card Files Community
vxbrandon commited on
Commit
e6ef6c5
•
1 Parent(s): e359845

End of training

Browse files
Files changed (4) hide show
  1. README.md +14 -4
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.0940
19
 
20
  ## Model description
21
 
@@ -45,7 +45,7 @@ The following hyperparameters were used during training:
45
  - total_eval_batch_size: 4
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - training_steps: 2350
49
 
50
  ### Training results
51
 
@@ -143,8 +143,18 @@ The following hyperparameters were used during training:
143
  | 2.131 | 0.36 | 2250 | 2.3719 |
144
  | 2.2687 | 0.36 | 2275 | 2.3695 |
145
  | 2.2486 | 0.37 | 2300 | 2.3693 |
146
- | 2.1452 | 0.37 | 2325 | 2.3679 |
147
- | 2.1846 | 0.38 | 2350 | 2.3699 |
 
 
 
 
 
 
 
 
 
 
148
 
149
 
150
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.0919
19
 
20
  ## Model description
21
 
 
45
  - total_eval_batch_size: 4
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
+ - training_steps: 2600
49
 
50
  ### Training results
51
 
 
143
  | 2.131 | 0.36 | 2250 | 2.3719 |
144
  | 2.2687 | 0.36 | 2275 | 2.3695 |
145
  | 2.2486 | 0.37 | 2300 | 2.3693 |
146
+ | 2.1445 | 0.37 | 2325 | 2.3708 |
147
+ | 2.1863 | 0.38 | 2350 | 2.3685 |
148
+ | 2.2238 | 0.38 | 2375 | 2.3670 |
149
+ | 2.2373 | 0.38 | 2400 | 2.3680 |
150
+ | 2.0792 | 0.39 | 2425 | 2.3685 |
151
+ | 2.0805 | 0.39 | 2450 | 2.3662 |
152
+ | 2.166 | 0.4 | 2475 | 2.3678 |
153
+ | 2.249 | 0.4 | 2500 | 2.3683 |
154
+ | 2.2577 | 0.4 | 2525 | 2.3706 |
155
+ | 2.1109 | 0.41 | 2550 | 2.3691 |
156
+ | 2.1343 | 0.41 | 2575 | 2.3677 |
157
+ | 2.2144 | 0.42 | 2600 | 2.3693 |
158
 
159
 
160
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9415452622dc50932e19e4c64e0d41609ef6d891ba9c5ab08c3b2fceb8391451
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a5336ceb88d83727181978159b424f8c1b95e8253fcdecc9112d5681756a573
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:71e78b13a231be89783af04223f40f3c72c67545c3badd2fb4c3ec483d430be2
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2456526ecb117aebc612d16313d67a761eec452e372720f66a0f2c7c201704f6
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6aad9538180658e7172282218a3c8a3914356f717d8331fee4b2b3311a635dff
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ba920a2cec936486b08a59db3a59ca7ec4e079186458a05622b1ff87ece605bd
3
  size 4540516344