FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
69
Aditya Kulshrestha PRO
Aditya02
·
AI & ML interests
None yet
Recent Activity
published
a model
about 14 hours ago
Aditya02/Qwen2-0.5B-GRPO-test
liked
a model
2 days ago
starvector/starvector-1b-im2svg
liked
a Space
16 days ago
nanotron/predict_memory
Organizations
