Aryanne
/

Orca-Mini-3B-gguf

Model card Files Files and versions

Here are a few GGUF(v2) quantizations of the model pankajmathur/orca_mini_3b

Downloads last month: 720

GGUF

Model size

3B params

Architecture

llama

Hardware compatibility

Log In to add your hardware

4-bit

5-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Datasets used to train Aryanne/Orca-Mini-3B-gguf

Spaces using Aryanne/Orca-Mini-3B-gguf 5