End of training

README.md

@@ -6,6 +6,8 @@ tags:
 - sft
 - generated_from_trainer
 base_model: Viet-Mistral/Vistral-7B-Chat
+datasets:
+- generator
 model-index:
 - name: vietnamese-news-summarization-vistral-7b
   results: []
@@ -17,7 +19,9 @@ should probably proofread and complete it, then remove this comment. -->
 [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/tritran/vietnamese-news-summarization/runs/psdy84l9)
 # vietnamese-news-summarization-vistral-7b
 
-This model is a fine-tuned version of [Viet-Mistral/Vistral-7B-Chat](https://huggingface.co/Viet-Mistral/Vistral-7B-Chat) on an unknown dataset.
+This model is a fine-tuned version of [Viet-Mistral/Vistral-7B-Chat](https://huggingface.co/Viet-Mistral/Vistral-7B-Chat) on the generator dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.2588
 
 ## Model description
 
@@ -45,6 +49,17 @@ The following hyperparameters were used during training:
 - lr_scheduler_warmup_steps: 0.03
 - training_steps: 100
 
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 1.3064        | 0.0060 | 20   | 1.3050          |
+| 1.2108        | 0.0119 | 40   | 1.2739          |
+| 1.2685        | 0.0179 | 60   | 1.2623          |
+| 1.4879        | 0.0239 | 80   | 1.2558          |
+| 1.3216        | 0.0298 | 100  | 1.2588          |
+
+
 ### Framework versions
 
 - PEFT 0.11.1