Some GGUF v2 quantizations of the model harborwater/wizard-orca-3b

It was trained on 2 epoch of pankajmathur's WizardLM_orca dataset.

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>

GGUF

Model size

3.43B params

Architecture

llama

4-bit

5-bit

Inference API

Unable to determine this model's library. Check the docs .

Aryanne
/

Wizard-Orca-3B-gguf

Dataset used to train Aryanne/Wizard-Orca-3B-gguf