Hugging Face model: RedHatAI/TinyLlama-1.1B-Chat-v0.4-pruned50-quant-ds
Author: RedHatAI
Created: 2023-11-20 19:10:02
Last modified: 2024-01-29 14:56:23
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 11
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:TinyLlama/TinyLlama-1.1B-Chat-v0.4, base_model:quantized:TinyLlama/TinyLlama-1.1B-Chat-v0.4, region:us
Base model relation: quantized
Base models: id: TinyLlama/TinyLlama-1.1B-Chat-v0.4
Card metadata:
base_model: TinyLlama/TinyLlama-1.1B-Chat-v0.4
inference: no
model_type: llama
prompt_template: 
user\n
{prompt}
\n

assistant\n

quantized_by: mwitiderrick
tags: deepsparse