--- license: apache-2.0 datasets: - HuggingFaceH4/ultrachat_200k language: - en base_model: Locutusque/TinyMistral-248M-v2-Instruct --- # Description GGUF version of [Locutusque/TinyMistral-248M-v2-Instruct](https://huggingface.co/Locutusque/TinyMistral-248M-v2-Instruct). # Recommended inference parameters ``` do_sample: true temperature: 0.1 top_p: 0.14 top_k: 12 repetition_penalty: 1.1 ``` # Recommended prompt template ``` <|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|> ```