Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Reset Other
AutoTrain Compatible
vllm
text-generation-inference
Inference Endpoints
custom_code
Other with no match
Eval Results
Merge
4-bit precision
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
10
Full-text search
Edit filters
Sort: Trending
Active filters:
vllm
Clear all
neuralmagic/Qwen2-72B-Instruct-FP8
Text Generation
•
Updated
2 days ago
•
16
•
1
neuralmagic/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
Updated
3 days ago
•
860
•
3
neuralmagic/Mixtral-8x7B-Instruct-v0.1-FP8
Text Generation
•
Updated
about 21 hours ago
•
63
•
1
neuralmagic/Meta-Llama-3-8B-Instruct-FP8-KV
Text Generation
•
Updated
2 days ago
•
3.34k
•
1
neuralmagic/Meta-Llama-3-70B-Instruct-FP8
Text Generation
•
Updated
3 days ago
•
66
Inferless/deciLM-7B-GPTQ
Text Generation
•
Updated
Jan 4
•
2
•
1
Inferless/SOLAR-10.7B-Instruct-v1.0-GPTQ
Text Generation
•
Updated
Jan 4
•
6
•
2
Inferless/Mixtral-8x7B-v0.1-int8-GPTQ
Text Generation
•
Updated
Jan 25
•
5
•
2
nm-testing/Mixtral-8x22B-Instruct-v0.1-FP8
Text Generation
•
Updated
2 days ago
•
9
neuralmagic/Mixtral-8x22B-Instruct-v0.1-FP8-dynamic
Text Generation
•
Updated
about 19 hours ago