File size: 1,863 Bytes
81a053b
 
 
 
 
 
e115261
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81a053b
f660b75
 
d516892
 
f660b75
81a053b
aa3078f
 
 
 
e115261
81a053b
e115261
 
 
81a053b
e115261
81a053b
e115261
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
---
library_name: transformers
tags:
- unsloth
- trl
- sft
language:
- en
- fi
- 'no'
- nb
- da
- sv
- is
datasets:
- mpasila/Viking-Instruct-Mix
- saillab/alpaca-icelandic-cleaned
- kobprof/skolegpt-instruct
- tollefj/nor-instruct-cleaned
- skvarre/sv-instruct-v1
- Gryphe/Sonnet3.5-SlimOrcaDedupCleaned-20k
- LumiOpen/instruction-collection-fin
- neph1/Alpaca-Lora-GPT4-Swedish-Refined
license: apache-2.0
---
Trained on all the 6 different languages so it should hopefully be useful for all of them though the quality of the datasets probably vary a lot.

Uses ChatML as usual.

LoRA: [mpasila/Viking-SlimInstruct-LoRA-V1-7B](https://huggingface.co/mpasila/Viking-SlimInstruct-LoRA-V1-7B)

Uses the following datasets:

[saillab/alpaca-icelandic-cleaned](https://huggingface.co/datasets/saillab/alpaca-icelandic-cleaned), [kobprof/skolegpt-instruct](https://huggingface.co/datasets/kobprof/skolegpt-instruct), [tollefj/nor-instruct-cleaned](https://huggingface.co/datasets/tollefj/nor-instruct-cleaned), [skvarre/sv-instruct-v1](https://huggingface.co/datasets/skvarre/sv-instruct-v1), [Gryphe/Sonnet3.5-SlimOrcaDedupCleaned-20k](https://huggingface.co/datasets/Gryphe/Sonnet3.5-SlimOrcaDedupCleaned-20k), [LumiOpen/instruction-collection-fin](https://huggingface.co/datasets/LumiOpen/instruction-collection-fin), [neph1/Alpaca-Lora-GPT4-Swedish-Refined](https://huggingface.co/datasets/neph1/Alpaca-Lora-GPT4-Swedish-Refined)

# Uploaded Viking-SlimInstruct-V1-7B model

- **Developed by:** mpasila
- **License:** apache-2.0
- **Finetuned from model :** LumiOpen/Viking-7B

This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)