Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
llama-cpp
Inference Endpoints
Merge
Eval Results
text-generation-inference
AutoTrain Compatible
Mixture of Experts
Carbon Emissions
text-embeddings-inference
custom_code
8-bit precision
Misc with no match
4-bit precision
Apply filters
Models
7,070
Full-text search
Edit filters
Sort: Trending
Active filters:
llama-cpp
Clear all
CHE-72/Baichuan2-7B-Chat-Q5_K_S-GGUF
Updated
Jun 22
•
14
CHE-72/Baichuan2-7B-Chat-Q5_0-GGUF
Updated
Jun 22
•
25
CHE-72/Baichuan2-7B-Chat-Q4_K_M-GGUF
Updated
Jun 22
•
19
CHE-72/Baichuan2-7B-Chat-Q4_K_S-GGUF
Updated
Jun 22
•
13
CHE-72/Baichuan2-7B-Chat-Q4_0-GGUF
Updated
Jun 22
•
11
CHE-72/Baichuan2-7B-Chat-Q3_K_L-GGUF
Updated
Jun 22
•
9
CHE-72/Baichuan2-7B-Chat-Q3_K_M-GGUF
Updated
Jun 22
•
13
CHE-72/Baichuan2-7B-Chat-Q3_K_S-GGUF
Updated
Jun 22
•
14
CHE-72/Baichuan2-7B-Chat-Q2_K-GGUF
Updated
Jun 22
•
11
CHE-72-ZLab/Alibaba-Qwen2-7B-Instruct-GGUF
Text Generation
•
Updated
Jun 23
•
141
CHE-72-ZLab/Alibaba-Qwen2-1_5B-Instruct-GGUF
Text Generation
•
Updated
Jun 23
•
303
CHE-72-ZLab/Alibaba-Qwen2-0_5B-Instruct-GGUF
Text Generation
•
Updated
Jun 23
•
174
CHE-72-ZLab/Microsoft-Phi3-14B-Instruct128K-GGUF
Text Generation
•
Updated
Jun 23
•
168
qnixsynapse/Mistral-7B-Instruct-v0.3-Q4_K_M-GGUF
Updated
Jun 22
•
18
VlSav/DeepSeek-V2-Lite-Chat-Q8_0-GGUF
Updated
Jun 22
•
11
CHE-72/Phi-3-mini-128k-instruct-Q8_0-GGUF
Text Generation
•
Updated
Jun 22
•
12
CHE-72/Phi-3-mini-128k-instruct-Q6_K-GGUF
Text Generation
•
Updated
Jun 22
•
13
CHE-72/TAIDE-LX-7B-Chat-Q8_0-GGUF
Updated
Jun 22
•
12
CHE-72/TAIDE-LX-7B-Chat-Q6_K-GGUF
Updated
Jun 22
•
6
CHE-72/TAIDE-LX-7B-Chat-Q5_K_M-GGUF
Updated
Jun 22
•
9
CHE-72/TAIDE-LX-7B-Chat-Q5_K_S-GGUF
Updated
Jun 22
•
15
CHE-72/TAIDE-LX-7B-Chat-Q5_0-GGUF
Updated
Jun 22
•
9
Johnyquest7/medllama3-v20-Q4_K_M-GGUF
Updated
Jun 22
•
17
•
1
CHE-72/TAIDE-LX-7B-Chat-Q4_K_M-GGUF
Updated
Jun 22
•
10
CHE-72/TAIDE-LX-7B-Chat-Q4_K_S-GGUF
Updated
Jun 22
•
5
CHE-72/TAIDE-LX-7B-Chat-Q4_0-GGUF
Updated
Jun 22
•
15
CHE-72/TAIDE-LX-7B-Chat-Q3_K_L-GGUF
Updated
Jun 22
•
20
CHE-72/TAIDE-LX-7B-Chat-Q3_K_M-GGUF
Updated
Jun 22
•
6
CHE-72/TAIDE-LX-7B-Chat-Q3_K_S-GGUF
Updated
Jun 22
•
5
CHE-72/TAIDE-LX-7B-Chat-Q2_K-GGUF
Updated
Jun 22
•
9
Previous
1
...
85
86
87
88
89
...
100
Next