Felladrin/TinyMistral-248M-SFT-v4-GGUF

Quantized GGUF model files for TinyMistral-248M-SFT-v4 from Felladrin

Original Model Card:

Locutusque's TinyMistral-248M trained on OpenAssistant TOP-1 Conversation Threads

Recommended Prompt Format

<|im_start|>user
{message}<|im_end|>
<|im_start|>assistant
Downloads last month
95
GGUF
Model size
248M params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for afrideva/TinyMistral-248M-SFT-v4-GGUF

Quantized
(12)
this model

Dataset used to train afrideva/TinyMistral-248M-SFT-v4-GGUF

Space using afrideva/TinyMistral-248M-SFT-v4-GGUF 1