Update README.md
Browse files
README.md
CHANGED
@@ -12,8 +12,8 @@ pipeline_tag: text-generation
|
|
12 |
|
13 |
|
14 |
This is an early v0.1 version release of our Instruct finetuned model from https://huggingface.co/Finnish-NLP/llama-7b-finnish \
|
15 |
-
Model was trained for 2 epochs using 11014 samples and for this release we chose checkpoint at 2500/4048 steps.
|
16 |
-
Future
|
17 |
|
18 |
For finetuning we used mix of the following datasets: \
|
19 |
LIMA from https://github.com/TurkuNLP/finnish-instructions \
|
|
|
12 |
|
13 |
|
14 |
This is an early v0.1 version release of our Instruct finetuned model from https://huggingface.co/Finnish-NLP/llama-7b-finnish \
|
15 |
+
Model was trained for 2 epochs using 11014 samples and for this release we chose checkpoint at 2500/4048 steps. \
|
16 |
+
Future DPO/SFT+DPO variants are in the pipeline.
|
17 |
|
18 |
For finetuning we used mix of the following datasets: \
|
19 |
LIMA from https://github.com/TurkuNLP/finnish-instructions \
|