A repo to store various quants of models, for convenient sharing and testing of freshly produced merges. Try at your own risk! Files may be deleted over time, usually due to them being released properly.

Don't forget to check my repo for all my other models!

Downloads last month: 52

GGUF

Model size

8.03B params

Architecture

llama

6-bit

Inference API

Unable to determine this model's library. Check the docs .