Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,8 @@ pipeline_tag: text-generation
|
|
12 |
|
13 |
|
14 |
This is an early v0.1 version release of our Instruct finetuned model from https://huggingface.co/Finnish-NLP/llama-7b-finnish \
|
15 |
-
Model was trained for 2 epochs using 11014 samples and for this release we chose checkpoint at 2500/4048 steps.
|
|
|
16 |
|
17 |
For finetuning we used mix of the following datasets: \
|
18 |
LIMA from https://github.com/TurkuNLP/finnish-instructions \
|
|
|
12 |
|
13 |
|
14 |
This is an early v0.1 version release of our Instruct finetuned model from https://huggingface.co/Finnish-NLP/llama-7b-finnish \
|
15 |
+
Model was trained for 2 epochs using 11014 samples and for this release we chose checkpoint at 2500/4048 steps.
|
16 |
+
Future versions are in the works using more data possibly DPO/SFT+DPO variants.
|
17 |
|
18 |
For finetuning we used mix of the following datasets: \
|
19 |
LIMA from https://github.com/TurkuNLP/finnish-instructions \
|