Hugging Face model: RedHatAI/Llama2-7b-chat-pruned50-quant-ds
Author: RedHatAI
Created: 2023-12-20 08:19:52
Last modified: 2024-01-10 16:22:07
Pipeline: text-generation
Library: transformers
Likes: 9 | Downloads: 10
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:NousResearch/Llama-2-7b-chat-hf, base_model:quantized:NousResearch/Llama-2-7b-chat-hf, region:us
Base model relation: quantized
Base models: id: NousResearch/Llama-2-7b-chat-hf
Card metadata:
base_model: NousResearch/Llama-2-7b-chat-hf
inference: no
model_type: llama
prompt_template: 

 
{prompt}
 


quantized_by: mwitiderrick
tags: deepsparse