Hugging Face model: RedHatAI/SOLAR-10.7B-Instruct-v1.0-pruned50-quant-ds
Author: RedHatAI
Created: 2023-12-19 04:21:37
Last modified: 2023-12-20 17:14:42
Pipeline: text-generation
Library: transformers
Likes: 5 | Downloads: 6
Tags: transformers, onnx, llama, text-generation, deepsparse, conversational, arxiv:2301.00774, base_model:upstage/SOLAR-10.7B-Instruct-v1.0, base_model:quantized:upstage/SOLAR-10.7B-Instruct-v1.0, region:us
Base model relation: quantized
Base models: id: upstage/SOLAR-10.7B-Instruct-v1.0
Card metadata:
base_model: upstage/SOLAR-10.7B-Instruct-v1.0
inference: no
model_type: llama
prompt_template: ### User:\n
{prompt}
### Assistant:\n

quantized_by: mwitiderrick
tags: deepsparse