Hugging Face model: RedHatAI/MiniChat-1.5-3B-pruned50-quant-ds
Author: RedHatAI
Created: 2023-12-06 11:44:00
Last modified: 2024-01-08 17:00:55
Pipeline: text-generation
Library: transformers
Likes: 1 | Downloads: 7
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:GeneZC/MiniChat-1.5-3B, base_model:quantized:GeneZC/MiniChat-1.5-3B, region:us
Base model relation: quantized
Base models: id: GeneZC/MiniChat-1.5-3B
Card metadata:
base_model: GeneZC/MiniChat-1.5-3B
inference: no
model_type: llama
prompt_template: 
 [|User|]\n
{prompt}

[|Assistant|]\n

quantized_by: mwitiderrick
tags: deepsparse