Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Reset Other
int4
AutoTrain Compatible
Inference Endpoints
text-generation-inference
4-bit precision
custom_code
Other with no match
Eval Results
Merge
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
24
Full-text search
Edit filters
Sort: Trending
Active filters:
int4
Clear all
Advantech-EIOT/intel_llama-2-chat-7b
Text Generation
•
Updated
Mar 12
•
1
neuralmagic/zephyr-7b-beta-marlin
Text Generation
•
Updated
Mar 6
•
4.18k
•
1
neuralmagic/TinyLlama-1.1B-Chat-v1.0-marlin
Text Generation
•
Updated
Mar 6
•
11.1k
•
1
neuralmagic/OpenHermes-2.5-Mistral-7B-marlin
Text Generation
•
Updated
Mar 6
•
235
•
2
neuralmagic/Nous-Hermes-2-Yi-34B-marlin
Text Generation
•
Updated
Mar 6
•
5
•
5
ecastera/ecastera-eva-westlake-7b-spanish-int4-gguf
Updated
Mar 16
•
8
•
1
softmax/Llama-2-70b-chat-hf-marlin
Text Generation
•
Updated
Mar 17
•
6
softmax/falcon-180B-chat-marlin
Text Generation
•
Updated
Mar 21
•
1
study-hjt/Meta-Llama-3-8B-Instruct-GPTQ-Int4
Text Generation
•
Updated
Apr 23
•
19
study-hjt/Meta-Llama-3-70B-Instruct-GPTQ-Int4
Text Generation
•
Updated
Apr 23
•
184
•
6
study-hjt/Meta-Llama-3-70B-Instruct-AWQ
Text Generation
•
Updated
Apr 23
•
21
study-hjt/Qwen1.5-110B-Chat-GPTQ-Int4
Text Generation
•
Updated
Apr 27
•
8
•
2
study-hjt/CodeQwen1.5-7B-Chat-GPTQ-Int4
Text Generation
•
Updated
Apr 26
•
87
study-hjt/Qwen1.5-110B-Chat-AWQ
Text Generation
•
Updated
Apr 27
•
8
modelscope/Yi-1.5-34B-Chat-AWQ
Text Generation
•
Updated
May 13
•
187
•
1
modelscope/Yi-1.5-6B-Chat-GPTQ
Text Generation
•
Updated
May 13
•
12
modelscope/Yi-1.5-6B-Chat-AWQ
Text Generation
•
Updated
May 13
•
167
modelscope/Yi-1.5-9B-Chat-GPTQ
Text Generation
•
Updated
May 13
•
37
•
1
modelscope/Yi-1.5-9B-Chat-AWQ
Text Generation
•
Updated
May 13
•
22
modelscope/Yi-1.5-34B-Chat-GPTQ
Text Generation
•
Updated
May 13
•
22
•
1
jojo1899/Phi-3-mini-128k-instruct-ov-int4
Text Generation
•
Updated
Jun 7
•
61
jojo1899/Llama-2-13b-chat-hf-ov-int4
Text Generation
•
Updated
Jun 7
•
19
jojo1899/Mistral-7B-Instruct-v0.2-ov-int4
Text Generation
•
Updated
Jun 7
•
22
model-scope/glm-4-9b-chat-GPTQ-Int4
Text Generation
•
Updated
6 days ago
•
34