FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
69
Howard Chen
HowardChenRV
·
AI & ML interests
None yet
Recent Activity
liked
a dataset
about 2 months ago
Congliu/Chinese-DeepSeek-R1-Distill-data-110k
liked
a model
2 months ago
deepseek-ai/DeepSeek-R1
liked
a model
2 months ago
deepseek-ai/DeepSeek-V3
Organizations
None yet