File size: 805 Bytes
f0e37be
 
5c85cd8
f0e37be
cfbbdc1
f0e37be
 
 
 
 
 
514a5a8
5c85cd8
 
f0e37be
9908fd6
f0e37be
ad02f18
 
f0e37be
 
 
 
514a5a8
f0e37be
 
 
5c85cd8
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
---
language:
- fi
license: apache-2.0
library_name: peft
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
base_model: LumiOpen/Viking-33B
datasets:
- mpasila/Finnish-ShareGPT-Tiny-V1-1
---
Uses my [tiny dataset](https://huggingface.co/datasets/mpasila/Finnish-ShareGPT-Tiny-V1-1) to train this bigger variant of Viking model family.

This LoRA uses the 1000B checkpoint.

# Uploaded  model

- **Developed by:** mpasila
- **License:** apache-2.0
- **Finetuned from model :** LumiOpen/Viking-33B

This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.

[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)