Hugging Face's logo

thrunlab
/
Mistral_Sparse_pretraining_80_percent

Transformers
Safetensors
mistral
trl
sft
Generated from Trainer
text-generation-inference
Model card Files
xet
 Community
lukeleeai commited on
Commit
a1e92d2
·
verified ·
1 Parent(s): 536d2fd

End of training

Browse files
Files changed (4) hide show
  1. README.md +1 -1
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on the openwebtext dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 2.7906
21
 
22
  ## Model description
23
 
 
17
 
18
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.1](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.1) on the openwebtext dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 1.9177
21
 
22
  ## Model description
23
 
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3ecccdb37fef31d2126b2021c6d94e60b9b78d310f66a0939a7ef7f5afbec5e7
3
  size 4943163992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:36c02e05ed195fcba3ae7f5260df1a5f27a70f69d59fef18c8743da6f2a6873f
3
  size 4943163992
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a198a3e09ab792154c62128697efbc9e7be3915cff0835ade1fd8571baa88810
3
  size 4999821144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:63630fde5d276c113df7f4a90006478c824032ef54d46c222e7afaf499183468
3
  size 4999821144
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3040952ef59c16199aab85cae307df024c3f1c9b93767a2a1d0bc49ee9d586e8
3
  size 4540517840
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e40f0e62ec2a0ffbd5979bd013bc81fdaf427c8ba293cab39d4305fc399573e2
3
  size 4540517840