A repo to store various quants of models, for convenient sharing and testing of freshly produced merges. Try at your own risk! Files may be deleted over time, usually due to them being released properly.
- Downloads last month
- 58
Hardware compatibility
Log In
to view the estimation
6-bit
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.