Hugging Face's logo

RikkiXu
/
zephyr-7b-sft-full

Text Generation
Transformers
TensorBoard
Safetensors
mistral
trl
sft
Generated from Trainer
conversational
text-generation-inference
Inference Endpoints
Model card Files Metrics Community
RikkiXu commited on
Commit
f890ded
•
1 Parent(s): c3da115

Model save

Browse files
Files changed (5) hide show
  1. README.md +6 -6
  2. model-00001-of-00003.safetensors +1 -1
  3. model-00002-of-00003.safetensors +1 -1
  4. model-00003-of-00003.safetensors +1 -1
  5. runs/Apr22_13-50-33_n136-128-070/events.out.tfevents.1713765130.n136-128-070.1187357.0 +2 -2
README.md CHANGED
@@ -19,7 +19,7 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  This model is a fine-tuned version of [imone/Mistral_7B_with_EOT_token](https://huggingface.co/imone/Mistral_7B_with_EOT_token) on the generator dataset.
21
  It achieves the following results on the evaluation set:
22
- - Loss: 0.3755
23
 
24
  ## Model description
25
 
@@ -55,11 +55,11 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|
58
- | 0.6331 | 1.0 | 578 | 0.6226 |
59
- | 0.51 | 2.0 | 1156 | 0.5023 |
60
- | 0.4058 | 3.0 | 1734 | 0.4172 |
61
- | 0.3003 | 4.0 | 2312 | 0.3773 |
62
- | 0.2508 | 5.0 | 2890 | 0.3755 |
63
 
64
 
65
  ### Framework versions
 
19
 
20
  This model is a fine-tuned version of [imone/Mistral_7B_with_EOT_token](https://huggingface.co/imone/Mistral_7B_with_EOT_token) on the generator dataset.
21
  It achieves the following results on the evaluation set:
22
+ - Loss: 0.3284
23
 
24
  ## Model description
25
 
 
55
 
56
  | Training Loss | Epoch | Step | Validation Loss |
57
  |:-------------:|:-----:|:----:|:---------------:|
58
+ | 0.6695 | 1.0 | 572 | 0.6610 |
59
+ | 0.523 | 2.0 | 1144 | 0.4895 |
60
+ | 0.3858 | 3.0 | 1716 | 0.3774 |
61
+ | 0.281 | 4.0 | 2288 | 0.3296 |
62
+ | 0.229 | 5.0 | 2860 | 0.3284 |
63
 
64
 
65
  ### Framework versions
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8a62c7f0a48449d090c54d4bb46049f0dba2babc8fc1e00e98fdd334183666f5
3
  size 4943178720
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:898125394c1d8957af8e8197984041948f092403b9c85fe87aec527b3afdf81f
3
  size 4943178720
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:02ba273e64ba948c6535ea2b1089d40576e4d52c037dfd8264be5021a989cacd
3
  size 4999819336
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a08db4ad63d0d59fb7c4c8aae22ebf56b86d423b0f8edb10767234dd10bcc2f8
3
  size 4999819336
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d67f94a9e1ee902ae2a0bc9a88ec88b9c931c92c8a2e88ce5c4fad33b59f8305
3
  size 4540532728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:db240af94994de350ee07c7b12e012e1177fb0025d5f618ae4f7bf023418ecc9
3
  size 4540532728
runs/Apr22_13-50-33_n136-128-070/events.out.tfevents.1713765130.n136-128-070.1187357.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:722652d99a2de1529646f0a9f3552049914423b3f171410c5c9566e67322cabf
3
- size 111573
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03835d9ee1fac8bae5d4dd44c15285576aa5335d3be31665dd2f8516c3118c4f
3
+ size 127390