Aryanne
/

Orca-Mini-3B-gguf

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Here are a few GGUF(v2) quantizations of the model pankajmathur/orca_mini_3b

Downloads last month: 795

GGUF

Model size

3.43B params

Architecture

llama

4-bit

5-bit

Inference API

Unable to determine this model's library. Check the docs .

Datasets used to train Aryanne/Orca-Mini-3B-gguf

Spaces using Aryanne/Orca-Mini-3B-gguf 6