FP8 LLMs for vLLM
Collection
Accurate FP8 quantized models by Neural Magic, ready for use with vLLM!
•
44 items
•
Updated
•
69
Aditya Kulshrestha PRO
Aditya02
·
AI & ML interests
None yet
Recent Activity
published
a model
3 days ago
Aditya02/Qwen2-0.5B-GRPO-test
liked
a model
5 days ago
starvector/starvector-1b-im2svg
liked
a Space
18 days ago
nanotron/predict_memory
Organizations
