Create README.md

README.md

@@ -0,0 +1,22 @@
+---
+language:
+- fi
+pipeline_tag: text-generation
+---
+# gpt3-finnish-8B-GGML
+
+Based on initial release of FinGPT-3 monolingual GPT-3-like model for Finnish from [TurkuNLP Research Group](https://huggingface.co/TurkuNLP).  
+This model is quantized GGML format binary of [gpt3-finnish-8B](https://huggingface.co/TurkuNLP/gpt3-finnish-8B).  
+| File | Description |
+| ---- | --- |
+| gpt3-finnish-8B.bloomz.ggml.q4_0.bin | 4 bit quantized. For inference using [bloomz.cpp](https://github.com/NouamaneTazi/bloomz.cpp) |
+
+```bash
+bloomz.cpp/main -m gpt3-finnish-8B.bloomz.ggml.q4_0.bin -t 4 -n 200 -p "Lasten loru:"
+```
+
+*Lasten loru:*  
+*Miten monta kärpässilmää,*  
+*lakki punainen tai sininen.*  
+*Vielä reppukin soma pieni!*  
+*Pulkkakin on lautaan tehty.*