Hugging Face's logo

thrunlab
/
Mistral_Sparse_refined_web_relu_2024-03-11

Text Generation
Transformers
Safetensors
sparse_mistral
Generated from Trainer
custom_code
Model card Files Community
vxbrandon commited on
Commit
b08b052
•
1 Parent(s): 2b35aad

End of training

Browse files
Files changed (4) hide show
  1. README.md +12 -2
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
README.md CHANGED
@@ -15,7 +15,7 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
- - Loss: 2.4529
19
 
20
  ## Model description
21
 
@@ -45,7 +45,7 @@ The following hyperparameters were used during training:
45
  - total_eval_batch_size: 4
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - training_steps: 1100
49
 
50
  ### Training results
51
 
@@ -95,6 +95,16 @@ The following hyperparameters were used during training:
95
  | 2.63 | 0.17 | 1050 | 2.7076 |
96
  | 2.6361 | 0.17 | 1075 | 2.7045 |
97
  | 2.5534 | 0.18 | 1100 | 2.7046 |
 
 
 
 
 
 
 
 
 
 
98
 
99
 
100
  ### Framework versions
 
15
 
16
  This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 2.4317
19
 
20
  ## Model description
21
 
 
45
  - total_eval_batch_size: 4
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
+ - training_steps: 1350
49
 
50
  ### Training results
51
 
 
95
  | 2.63 | 0.17 | 1050 | 2.7076 |
96
  | 2.6361 | 0.17 | 1075 | 2.7045 |
97
  | 2.5534 | 0.18 | 1100 | 2.7046 |
98
+ | 2.5756 | 0.18 | 1125 | 2.7031 |
99
+ | 2.5632 | 0.18 | 1150 | 2.6989 |
100
+ | 2.5971 | 0.19 | 1175 | 2.6960 |
101
+ | 2.4719 | 0.19 | 1200 | 2.6963 |
102
+ | 2.5377 | 0.2 | 1225 | 2.6944 |
103
+ | 2.552 | 0.2 | 1250 | 2.6907 |
104
+ | 2.5748 | 0.2 | 1275 | 2.6894 |
105
+ | 2.5799 | 0.21 | 1300 | 2.6877 |
106
+ | 2.5566 | 0.21 | 1325 | 2.6830 |
107
+ | 2.4415 | 0.22 | 1350 | 2.6818 |
108
 
109
 
110
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:fa789a0e9fa4506b2a6fc3e6de5c7a5875a9c1d20054669307a8b13d68343f64
3
  size 4943162336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7401179e56edb5c659ca9fe928b036d9a0c55233ec041ab2066102cd5c812e2e
3
  size 4943162336
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:756a9991a730502b124438dcddeb71a2c6e9e19b92c666c254d46ecf7be30451
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c13d8d6247ff9cb0ebdd8754a6cf9c7619f69035d981457bd6ca60ea49fb11c
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:759a08405b9227f8376fab3730edc3be9812cca52315771517f87ff5ef416b25
3
  size 4540516344
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:22e6a733cfebbb872c80aefcc2d3dd018382aa7bd83b84a38b5f0e781fc21bd1
3
  size 4540516344