Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
quantized
text-generation-inference
4-bit precision
Inference Endpoints
AutoTrain Compatible
8-bit precision
Merge
Eval Results
Mixture of Experts
custom_code
Carbon Emissions
text-embeddings-inference
Apply filters
Models
1,523
Full-text search
Edit filters
Sort: Trending
Active filters:
quantized
Clear all
MaziyarPanahi/gemma-2-2b-it-GGUF
Text Generation
•
Updated
Aug 1
•
2.47k
•
4
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit
Text Generation
•
Updated
Aug 2
•
10
MaziyarPanahi/calme-2.2-qwen2-72b-GGUF
Text Generation
•
Updated
Aug 6
•
354
•
2
legraphista/Palmyra-Fin-70B-32K-IMat-GGUF
Text Generation
•
Updated
Aug 2
•
1.15k
•
6
liemo/open-lilm-v2-q4
Text Generation
•
Updated
7 days ago
•
19
legraphista/internlm2_5-1_8b-chat-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
378
legraphista/internlm2_5-20b-chat-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
193
legraphista/shieldgemma-2b-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
233
legraphista/shieldgemma-9b-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
450
legraphista/shieldgemma-27b-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
712
•
1
MaziyarPanahi/RYS-XLarge-GGUF
Text Generation
•
Updated
Aug 6
•
470
•
7
MaziyarPanahi/calme-2.3-legalkit-8b-GGUF
Text Generation
•
Updated
Aug 7
•
473
•
8
MaziyarPanahi/Qwen2-Math-1.5B-Instruct-GGUF
Text Generation
•
Updated
Aug 8
•
75
•
2
MaziyarPanahi/Qwen2-Math-7B-Instruct-GGUF
Text Generation
•
Updated
Aug 8
•
211
•
1
MaziyarPanahi/Qwen2-Math-72B-Instruct-GGUF
Text Generation
•
Updated
Aug 20
•
243
•
2
legraphista/Qwen2-Math-1.5B-Instruct-IMat-GGUF
Text Generation
•
Updated
Aug 8
•
770
legraphista/Qwen2-Math-7B-Instruct-IMat-GGUF
Text Generation
•
Updated
Aug 8
•
180
•
1
legraphista/Qwen2-Math-72B-Instruct-IMat-GGUF
Text Generation
•
Updated
Aug 8
•
187
legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF
Text Generation
•
Updated
Aug 16
•
586
legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF
Text Generation
•
Updated
Aug 16
•
737
HHD-QiXuan/RYS-XLarge-GGUF
Text Generation
•
Updated
Aug 18
•
133
•
1
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
Updated
Aug 17
•
3.57k
•
13
legraphista/Minitron-4B-Base-GGUF
Text Generation
•
Updated
Aug 17
•
261
MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF
Text Generation
•
Updated
Aug 18
•
324k
•
5
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
Updated
Aug 19
•
522
legraphista/Llama-3.1-Storm-8B-IMat-GGUF
Text Generation
•
Updated
Aug 20
•
724
legraphista/Phi-3.5-mini-instruct-IMat-GGUF
Text Generation
•
Updated
Aug 20
•
247
MaziyarPanahi/Phi-3.5-mini-instruct-GGUF
Text Generation
•
Updated
Aug 20
•
683
•
2
legraphista/Mistral-NeMo-Minitron-8B-Base-IMat-GGUF
Text Generation
•
Updated
Aug 21
•
626
jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
Updated
Aug 22
•
22
Previous
1
...
47
48
49
50
51
Next