YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

IMPORTANT!!!!!

This gguf model is outputting in latin. probably because quantization it self is wrong. I will later quantize it with Apples mlx framework the model will then be in .safetensors format.

Downloads last month: 151

GGUF

Model size

3.03B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.