rawsh commited on
Commit
9c9d508
1 Parent(s): 82ea5cb

Model save

Browse files
Files changed (2) hide show
  1. README.md +4 -3
  2. generation_config.json +8 -0
README.md CHANGED
@@ -1,17 +1,18 @@
1
  ---
2
- base_model: Qwen/Qwen2-0.5B-Instruct
3
  library_name: transformers
4
  model_name: mirrorqwen2.5-0.5b-SimPO
5
  tags:
6
  - generated_from_trainer
7
  - trl
8
  - cpo
 
9
  licence: license
10
  ---
11
 
12
  # Model Card for mirrorqwen2.5-0.5b-SimPO
13
 
14
- This model is a fine-tuned version of [Qwen/Qwen2-0.5B-Instruct](https://huggingface.co/Qwen/Qwen2-0.5B-Instruct).
15
  It has been trained using [TRL](https://github.com/huggingface/trl).
16
 
17
  ## Quick start
@@ -27,7 +28,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/dankgpt/huggingface/runs/tsy83cdb)
31
 
32
  This model was trained with CPO, a method introduced in [Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation](https://huggingface.co/papers/2401.08417).
33
 
 
1
  ---
2
+ base_model: rawsh/mirrorqwen2.5-0.5b-SFT
3
  library_name: transformers
4
  model_name: mirrorqwen2.5-0.5b-SimPO
5
  tags:
6
  - generated_from_trainer
7
  - trl
8
  - cpo
9
+ - unsloth
10
  licence: license
11
  ---
12
 
13
  # Model Card for mirrorqwen2.5-0.5b-SimPO
14
 
15
+ This model is a fine-tuned version of [rawsh/mirrorqwen2.5-0.5b-SFT](https://huggingface.co/rawsh/mirrorqwen2.5-0.5b-SFT).
16
  It has been trained using [TRL](https://github.com/huggingface/trl).
17
 
18
  ## Quick start
 
28
 
29
  ## Training procedure
30
 
31
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/dankgpt/simpo-training/runs/s9v84tp1)
32
 
33
  This model was trained with CPO, a method introduced in [Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translation](https://huggingface.co/papers/2401.08417).
34
 
generation_config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 151643,
3
+ "eos_token_id": 151643,
4
+ "max_length": 32768,
5
+ "max_new_tokens": 2048,
6
+ "pad_token_id": 151665,
7
+ "transformers_version": "4.46.2"
8
+ }