Sasa Zelenovic

szelenovic's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a collection 3 days ago

Sparse-Llama-3.1-2of4

Collection

2:4 sparse versions of Llama-3.1, including transfer learning • 7 items • Updated 7 days ago • 3

upvoted a paper 24 days ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published 25 days ago • 45

upvoted a collection 4 months ago

Llama-3.1 Quantization

Collection

Neural Magic quantized Llama-3.1 models • 22 items • Updated 6 days ago • 39

upvoted a collection 5 months ago

FP8 LLMs for vLLM

Collection

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 44 items • Updated Oct 17 • 59

upvoted a paper about 1 year ago

QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models

Paper • 2310.16795 • Published Oct 25, 2023 • 26