Lyra4-Gutenberg2-12B EXL2
Collection
3 items
•
Updated
Lyra4-Gutenberg2-12B-6bpw-h8-exl2
This is a 6bpw h8 exl2 quant of Lyra4-Gutenberg2-12B
Built-in(default) calibration dataset is used.
- Downloads last month
- 6
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.