Hugging Face model: RedHatAI/Nous-Hermes-2-SOLAR-10.7B-pruned50-quant-ds
Author: RedHatAI
Created: 2024-01-04 07:04:58
Last modified: 2024-01-10 16:22:25
Pipeline: text-generation
Library: transformers
Likes: 7 | Downloads: 8
Tags: transformers, onnx, llama, text-generation, deepsparse, conversational, arxiv:2301.00774, base_model:NousResearch/Nous-Hermes-2-SOLAR-10.7B, base_model:quantized:NousResearch/Nous-Hermes-2-SOLAR-10.7B, region:us
Base model relation: quantized
Base models: id: NousResearch/Nous-Hermes-2-SOLAR-10.7B
Card metadata:
base_model: NousResearch/Nous-Hermes-2-SOLAR-10.7B
inference: no
model_type: llama
prompt_template: ### User:\n
{prompt}
### Assistant:\n

quantized_by: mwitiderrick
tags: deepsparse