Hugging Face's logo

RyanYr
/
self-correct_Ministral8Bit_mMQA-mix_iter4

Text Generation
Transformers
Safetensors
mistral
Generated from Trainer
trl
dpo
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
RyanYr commited on
Commit
572100d
•
1 Parent(s): 358c7e4

Model save

Browse files
Files changed (6) hide show
  1. README.md +1 -1
  2. last_checkpoint/model-00001-of-00004.safetensors +1 -1
  3. last_checkpoint/model-00002-of-00004.safetensors +1 -1
  4. last_checkpoint/model-00003-of-00004.safetensors +1 -1
  5. last_checkpoint/model-00004-of-00004.safetensors +1 -1
  6. last_checkpoint/training_args.bin +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/l4bi6uzm)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/yyr/huggingface/runs/21ntau9j)
31
 
32
  This model was trained with DPO, a method introduced in [Direct Preference Optimization: Your Language Model is Secretly a Reward Model](https://huggingface.co/papers/2305.18290).
33
 
last_checkpoint/model-00001-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36b86e5e9b16ec1e968d765263692711bd08c8b25725b1c1268cc4c2c07e24c1
3
  size 4983016096
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3fbb83b0f2f532359c01100b9b0fb0c136696deb93f993bb66aefc56955c2444
3
  size 4983016096
last_checkpoint/model-00002-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:47a047d269a076249edf787b4ebc09aa2a000c24a2f5f3644879cf0defbbc721
3
  size 4999836776
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f4ad13f9e4dab20014b8928446c50f20bde63cb97a5b2bb94d2c603c88b8a65
3
  size 4999836776
last_checkpoint/model-00003-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f971b52c136eb54f913fd12b9262903cc76ecf24907b911a020eb310ca291b0
3
  size 4983067960
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3a19988371d675ae20c35ac008650011a84dc7ea3ce9feb0b1e39cf9276e4012
3
  size 4983067960
last_checkpoint/model-00004-of-00004.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d3a1ca70e821839c3c84f8c74ad3321cc31a51327d3572321f24136305f9fc3a
3
  size 1073750144
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f806c9124097c3d851787e6e9e4b2b6a483c23709b7583a7ad0e846201d05f5
3
  size 1073750144
last_checkpoint/training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:96cd4db97a89c4328a093065aebebf8e2ea8036d982ce2aafa1a10b3054a0d7b
3
  size 7992
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d54d99948df8f87b79f13d2f8f10f517eb65e74389b7801acbad6346b0c805e8
3
  size 7992