A repo to store various quants of models, for convenient sharing and testing of freshly produced merges. Try at your own risk! Files may be deleted over time, usually due to them being released properly.

Don't forget to check my repo for all my other models!

Downloads last month: 87

GGUF

Model size

8.03B params

Architecture

llama

6-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.