Alexander Matveev

alexm-nm's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 5 months ago

"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization

Paper • 2411.02355 • Published Nov 4, 2024 • 50

liked a model 10 months ago

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.4k • 18

updated 8 models 11 months ago

alexm-nm/tinyllama-24-gptq-8bit-channelwise

Text Generation • Updated May 8, 2024 • 17

alexm-nm/tinyllama-24-marlin24-8bit-channelwise

Text Generation • Updated May 8, 2024 • 66 • 1

alexm-nm/tinyllama-24-gptq-8bit-g128

Text Generation • Updated May 8, 2024 • 2.98k

alexm-nm/tinyllama-24-marlin24-8bit-g128

Text Generation • Updated May 8, 2024 • 5.95k • 1

alexm-nm/tinyllama-24-gptq-4bit-channelwise

Text Generation • Updated May 8, 2024 • 18

alexm-nm/tinyllama-24-marlin24-4bit-channelwise

Text Generation • Updated May 8, 2024 • 65 • 1

alexm-nm/tinyllama-24-gptq-4bit-g128

Text Generation • Updated May 8, 2024 • 2.98k

alexm-nm/tinyllama-24-marlin24-4bit-g128

Text Generation • Updated May 8, 2024 • 13.5k • 1