Hugging Face model: RedHatAI/Nous-Hermes-llama-2-7b-pruned50-quant-ds
Author: RedHatAI
Created: 2023-12-20 03:20:19
Last modified: 2023-12-20 08:17:33
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 5
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:NousResearch/Nous-Hermes-llama-2-7b, base_model:quantized:NousResearch/Nous-Hermes-llama-2-7b, region:us
Base model relation: quantized
Base models: id: NousResearch/Nous-Hermes-llama-2-7b
Card metadata:
base_model: NousResearch/Nous-Hermes-llama-2-7b
inference: no
model_type: llama
prompt_template: ### Instruction:
{prompt}
### Response:

quantized_by: mwitiderrick
tags: deepsparse