Hugging Face model: TheBloke/orca_mini_v3_7B-AWQ
Author: TheBloke
Created: 2023-09-19 07:16:06
Last modified: 2023-11-09 18:20:08
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 9
Tags: transformers, safetensors, llama, text-generation, en, dataset:psmathur/orca_mini_v1_dataset, dataset:ehartford/dolphin, arxiv:2306.02707, arxiv:2302.13971, base_model:pankajmathur/orca_mini_v3_7b, base_model:quantized:pankajmathur/orca_mini_v3_7b, license:other, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: pankajmathur/orca_mini_v3_7b
Card metadata:
language: en
license: other
library_name: transformers
datasets: psmathur/orca_mini_v1_dataset, ehartford/dolphin
model_name: Orca Mini v3 7B
base_model: psmathur/orca_mini_v3_7b
inference: no
model_creator: Pankaj Mathur
model_type: llama
pipeline_tag: text-generation
prompt_template: ### System:
You are an AI assistant that follows instruction extremely well. Help as much as you can.

### User:
{prompt}

### Input:
{input}

### Response:

quantized_by: TheBloke