Model: RedHatAI/Llama2-7b-chat-pruned50-quant-ds
Author: RedHatAI
Pipeline: text-generation
Library: transformers
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:NousResearch/Llama-2-7b-chat-hf, base_model:quantized:NousResearch/Llama-2-7b-chat-hf, region:us
Base models (quantized): id: NousResearch/Llama-2-7b-chat-hf
Card metadata: base_model: NousResearch/Llama-2-7b-chat-hf
inference: no
model_type: llama
prompt_template: 

 
{prompt}
 


quantized_by: mwitiderrick
tags: deepsparse
Likes: 9 | All-time downloads: 700
Created: 2023-12-20 08:19:52