Hugging Face model: mgoin/Orca-2-13b-pruned50-quant-ds
Author: mgoin
Created: 2023-11-22 14:45:32
Last modified: 2023-11-26 21:56:37
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 5
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:microsoft/Orca-2-13b, base_model:quantized:microsoft/Orca-2-13b, region:us
Base model relation: quantized
Base models: id: microsoft/Orca-2-13b
Card metadata:
base_model: microsoft/Orca-2-13b
inference: no
model_type: llama
prompt_template: 
system
{system_message}


user
{prompt}


assistant

quantized_by: mgoin
tags: deepsparse