Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,16 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# gpt3-finnish-3B-GGML
|
2 |
+
|
3 |
+
Based on initial release of FinGPT-3 monolingual GPT-3-like model for Finnish from [TurkuNLP Research Group](https://huggingface.co/TurkuNLP).
|
4 |
+
This model is quantized GGML format binary of [gpt3-finnish-3B](https://huggingface.co/TurkuNLP/gpt3-finnish-3B).
|
5 |
+
| File | Description |
|
6 |
+
| ---- | --- |
|
7 |
+
| gpt3-finnish-3B.bloomz.ggml.q4_0.bin | 4 bit quantized. For inference using [bloomz.cpp](https://github.com/NouamaneTazi/bloomz.cpp) |
|
8 |
+
|
9 |
+
```bash
|
10 |
+
bloomz.cpp/main -m gpt3-finnish-3B.bloomz.ggml.q4_0.bin -t 4 -n 200 -p "Lasten loru:"
|
11 |
+
```
|
12 |
+
|
13 |
+
*Lasten loru:*
|
14 |
+
*Lauri seulassa,*
|
15 |
+
*pitkä tukka tuulessa.*
|
16 |
+
*Lalli saunassa, kirves kainalossa.*
|