Hugging Face model: RedHatAI/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse
Author: RedHatAI
Created: 2024-03-15 15:45:40
Last modified: 2024-05-07 15:27:49
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 3
Tags: transformers, onnx, llama, text-generation, sparse, chat, deepsparse, conversational, dataset:cerebras/SlimPajama-627B, dataset:HuggingFaceH4/ultrachat_200k, arxiv:2405.03594, arxiv:2009.03300, arxiv:1905.07830, arxiv:1907.10641, arxiv:1911.01547, arxiv:2109.07958, arxiv:2107.03374, arxiv:2110.14168, base_model:RedHatAI/Llama-2-7b-ultrachat200k-pruned_50, base_model:quantized:RedHatAI/Llama-2-7b-ultrachat200k-pruned_50, region:us
Base model relation: quantized
Base models: id: RedHatAI/Llama-2-7b-ultrachat200k-pruned_50
Card metadata:
base_model: neuralmagic/Llama-2-7b-pruned50-retrained-ultrachat
inference: no
model_type: llama
pipeline_tag: text-generation
datasets: cerebras/SlimPajama-627B, HuggingFaceH4/ultrachat_200k
tags: sparse, chat, deepsparse