Update README.md

README.md

@@ -124,6 +124,29 @@ sequences = pipeline(
 print(sequences[0]['generated_text'])
 ```
 
+* **4-bit quantized version** is available here : [jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF](https://huggingface.co/jpacifico/Chocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF)
+
+* **Ollama**: [jpacifico/chocolatine-3b](https://ollama.com/jpacifico/chocolatine-3b)
+
+```bash
+ollama run jpacifico/chocolatine-3b
+```
+
+Ollama *Modelfile* example :
+
+```bash
+FROM ./chocolatine-3b-instruct-dpo-revised-q4_k_m.gguf
+TEMPLATE """{{ if .System }}<|system|>
+{{ .System }}<|end|>
+{{ end }}{{ if .Prompt }}<|user|>
+{{ .Prompt }}<|end|>
+{{ end }}<|assistant|>
+{{ .Response }}<|end|>
+"""
+PARAMETER stop """{"stop": ["<|end|>","<|user|>","<|assistant|>"]}"""
+SYSTEM """You are a friendly assistant called Chocolatine."""
+```
+
 ### Limitations
 
 The Chocolatine model is a quick demonstration that a base model can be easily fine-tuned to achieve compelling performance.