FocusMix 7B GGUF
Using llama.cpp release b3557 for static quantization.
Original model: https://huggingface.co/Nelathan/Qwen2-7B-FocusMix
ChatML
<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>
- Downloads last month
- 19
Hardware compatibility
Log In
to view the estimation
4-bit
5-bit
6-bit
8-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for Nelathan/Qwen2-7b-FocusMix-GGUF
Base model
Nelathan/Qwen2-7B-FocusMix