ChatC5 7.12B (GGUF)

This is ChatC5, a local LLM fine-tuned and exported to GGUF format.

Files

Run with llama.cpp:

./llama-cli -m chatc5.gguf -p "Hello"

GGUF

Model size

4B params

Architecture

phi3

Hardware compatibility

We're not able to determine the quantization variants.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support