Alexander Matveev's picture

1 1

Alexander Matveev

alexm-nm

·

http://www.neuralmagic.com

alexm-nm

AI & ML interests

AI performance

Recent Activity

upvoted a paper 18 days ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

View all activity

Organizations

models 8

alexm-nm/tinyllama-24-gptq-8bit-channelwise

Text Generation • Updated May 8 • 531

alexm-nm/tinyllama-24-marlin24-8bit-channelwise

Text Generation • Updated May 8 • 746 • 1

alexm-nm/tinyllama-24-gptq-8bit-g128

Text Generation • Updated May 8 • 2.31k

alexm-nm/tinyllama-24-marlin24-8bit-g128

Text Generation • Updated May 8 • 3.44k • 1

alexm-nm/tinyllama-24-gptq-4bit-channelwise

Text Generation • Updated May 8 • 543

alexm-nm/tinyllama-24-marlin24-4bit-channelwise

Text Generation • Updated May 8 • 769 • 1

alexm-nm/tinyllama-24-gptq-4bit-g128

Text Generation • Updated May 8 • 2.34k

alexm-nm/tinyllama-24-marlin24-4bit-g128

Text Generation • Updated May 8 • 13.4k • 1

datasets

None public yet