Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,8 @@ pipeline_tag: text-generation
|
|
| 12 |
|
| 13 |
|
| 14 |
This is an early v0.1 version release of our Instruct finetuned model from https://huggingface.co/Finnish-NLP/llama-7b-finnish \
|
| 15 |
-
Model was trained for 2 epochs using 11014 samples and for this release we chose checkpoint at 2500/4048 steps.
|
|
|
|
| 16 |
|
| 17 |
For finetuning we used mix of the following datasets: \
|
| 18 |
LIMA from https://github.com/TurkuNLP/finnish-instructions \
|
|
|
|
| 12 |
|
| 13 |
|
| 14 |
This is an early v0.1 version release of our Instruct finetuned model from https://huggingface.co/Finnish-NLP/llama-7b-finnish \
|
| 15 |
+
Model was trained for 2 epochs using 11014 samples and for this release we chose checkpoint at 2500/4048 steps.
|
| 16 |
+
Future versions are in the works using more data possibly DPO/SFT+DPO variants.
|
| 17 |
|
| 18 |
For finetuning we used mix of the following datasets: \
|
| 19 |
LIMA from https://github.com/TurkuNLP/finnish-instructions \
|