laurentiubp commited on
Commit
a3bda69
1 Parent(s): 64e0234

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -22,6 +22,8 @@ pipeline_tag: text-generation
22
 
23
  **catallama/CataLlama-v0.1-Instruct-DPO** is a DPO fine-tune of [catallama/CataLlama-v0.1-Instruct-SFT](https://huggingface.co/catallama/CataLlama-v0.1-Instruct-SFT) on the [catallama/Catalan-DPO](https://huggingface.co/datasets/catallama/Catalan-DPO) dataset.
24
 
 
 
25
  The model shows improved proficiency with the Catalan language.
26
 
27
  **This is an instruction fine-tuned model, optimised with DPO, proficient on the following tasks in Catalan**
 
22
 
23
  **catallama/CataLlama-v0.1-Instruct-DPO** is a DPO fine-tune of [catallama/CataLlama-v0.1-Instruct-SFT](https://huggingface.co/catallama/CataLlama-v0.1-Instruct-SFT) on the [catallama/Catalan-DPO](https://huggingface.co/datasets/catallama/Catalan-DPO) dataset.
24
 
25
+ CataLlama was trained on roughly **445 million new tokens** in three separate stages. This is the 3rd and final stage of the training.
26
+
27
  The model shows improved proficiency with the Catalan language.
28
 
29
  **This is an instruction fine-tuned model, optimised with DPO, proficient on the following tasks in Catalan**