Edit model card

I made a couple more models just for fun. I can’t vouch for the quality, since I didn’t do any tests. Link to the original model and the script with which I created these models:

Downloads last month
46
GGUF
Model size
10.7B params
Architecture
llama

4-bit

5-bit

Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.