Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Freezed
Misc
Reset Misc
gguf
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
4-bit precision
Merge
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
29,642
Full-text search
Edit filters
Sort: Trending
Active filters:
gguf
Clear all
RichardErkhov/chujiezheng_-_Starling-LM-7B-alpha-ExPO-gguf
Updated
Jun 25
•
250
NikolayKozloff/Replete-Coder-Llama3-8B-Q5_0-GGUF
Updated
Jun 25
•
21
•
1
cc8055/tinyllamafullprecision20k-GGUF
Updated
Jul 1
•
139
QuantFactory/NuExtract-GGUF
Updated
Jun 25
•
133
epsilondelta1982/Meta-llama3-8b-instruct-GGUF
Updated
Jun 25
•
107
NikolayKozloff/Replete-Coder-Llama3-8B-IQ4_NL-GGUF
Updated
Jun 25
•
13
•
1
you212121/llama-3-8b-Instruct-bnb-4bit-aiaustin-demo
Updated
Jun 25
QuantFactory/NuExtract-tiny-GGUF
Updated
Jun 25
•
299
Sc0m3r/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation
•
Updated
Jun 25
•
8
junxun/LLamav5
Updated
Jun 25
•
11
BaunRobotics/Qwen-tinybaun-k12-GGUF
Updated
Jul 4
•
218
AlekseyElygin/Qwen2-0.5B-GGUF
Updated
Jun 25
•
67
vincentmireau/summary-llama3-8b-Q4_k_m
Updated
Jun 25
•
89
QuantFactory/Replete-Coder-Qwen2-1.5b-GGUF
Updated
Jun 25
•
256
RichardErkhov/aloobun_-_CosmicBun-8B-gguf
Updated
Jun 25
•
304
mradermacher/mexa-22b-i1-GGUF
Updated
15 days ago
•
146
nazimali/gte-Qwen2-7B-instruct-Q6_K-GGUF
Sentence Similarity
•
Updated
Jun 25
•
24
RichardErkhov/MaziyarPanahi_-_Llama-3-8B-Instruct-v0.8-gguf
Updated
Jun 25
•
364
QuantFactory/tabula-8b-GGUF
Updated
Jun 25
•
170
QuantFactory/Replete-Coder-Llama3-8B-GGUF
Updated
Jun 25
•
236
RichardErkhov/codellama_-_CodeLlama-70b-hf-gguf
Updated
Jun 26
•
490
Raunak1/EI-Mistral-Q4_0-GGUF
Updated
Jun 25
•
51
•
1
LLukas22/DeepSeek-Coder-V2-Lite-Instruct-Q4_0-GGUF
Updated
Jun 25
•
120
xX-FANE-Xx/mistral-7b-eufaq-merged-Q8_0-GGUF
Updated
Jun 25
•
8
RichardErkhov/flemmingmiguel_-_MBX-7B-v2-gguf
Updated
Jun 25
•
446
Jianping746/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF
Updated
Jun 25
•
10
aimlresearch2023/gpt2-Q4_K_M-GGUF
Updated
Jun 25
•
15
RichardErkhov/unsloth_-_mistral-7b-instruct-v0.3-gguf
Updated
Jun 25
•
268
RichardErkhov/Mihaiii_-_Llama-3-pruned-45B-Drobeta-Turnu-Severin-gguf
Updated
Jun 26
•
446
jkrahmann/Meta-Llama-3-8B-Q4_K_M-GGUF
Text Generation
•
Updated
Jun 25
•
13
Previous
1
...
708
709
710
711
712
...
989
Next