mradermacher/Nemotron-4-340B-Instruct-hf-i1-GGUF
Updated
•
1
Edit Models filters
Active filters:
vllm
mradermacher/Nemotron-4-340B-Base-hf-GGUF
Updated
neuralmagic/SmolLM-360M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
65
neuralmagic/SmolLM-135M-Instruct-quantized.w8a8
Text Generation
•
Updated
•
356
mradermacher/Nemotron-4-340B-Base-hf-i1-GGUF
Updated
•
1
cmshin96/MN-12B-Lyra-v3-awq
Text Generation
•
Updated
•
11
cmshin96/MN-12B-Lyra-v1-awq
Text Generation
•
Updated
•
11
cmshin96/MN-12B-Lyra-v4-awq
Text Generation
•
Updated
•
8
LlamaFinetuneBase/Pixtral-12B-2409
Updated
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation
•
Updated
•
176
neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic
Text Generation
•
Updated
•
698
•
2
soprasteria/Mixtral-8x7B-Instruct-v0.1-FP8
Updated
•
131
TouchNight/Ministral-8B-Instruct-2410-HF
Updated
•
66
TouchNight/Ministral-8B-Instruct-2410-HF-Q5_K_M-GGUF
Updated
•
3
ijohn07/Ministral-8B-Instruct-2410-HF-Q8_0-GGUF
Updated
•
5
adriabama06/reader-lm-1.5b-AWQ
Text Generation
•
Updated
•
19
•
1
sasha0552/Ministral-8B-Instruct-2410
Updated
QuantFactory/TouchNight-Ministral-8B-Instruct-2410-HF-GGUF
Updated
•
127
•
2
GrimsenClory/Ministral-8B-Instruct-2410-Q6_K-GGUF
Updated
•
13
gphorvath/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
•
14
Gleisson1/Ministral-8B-Instruct-2410-HF-4bit
Updated
•
23
paultimothymooney/Ministral-8B-Instruct-2410-Q8_0-GGUF
Updated
•
6
paultimothymooney/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
•
6
LouiSeHU/Mistral-Small-Instruct-2409-Q4_0-GGUF
Updated
•
26
yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
•
5
Ritvik19/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
•
5
Gustav0-Freind/missmall
Updated
•
4
yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
•
Updated
•
11
SicariusSicariiStuff/DeepSeek-Coder-V2-Instruct-FP8
Updated
•
10
neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic
Text Generation
•
Updated
•
120