"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
•
2411.02355
•
Published
•
46
Shubhra Pandit
shubhrapandit
AI & ML interests
None yet
Recent Activity
updated
a model
1 day ago
nm-testing/pixtral-12b-w4a16-actorder-weight
updated
a model
1 day ago
nm-testing/pixtral-12b-w8a8-noactorder
updated
a model
1 day ago
nm-testing/pixtral-12b-w4a16-actorder-group
Organizations
