Hugging Face model: RedHatAI/MiniChat-3B-pruned50-quant-ds
Author: RedHatAI
Created: 2023-11-30 14:39:22
Last modified: 2024-01-02 08:24:04
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 8
Tags: transformers, onnx, llama, text-generation, deepsparse, arxiv:2301.00774, base_model:GeneZC/MiniChat-3B, base_model:quantized:GeneZC/MiniChat-3B, region:us
Base model relation: quantized
Base models: id: GeneZC/MiniChat-3B
Card metadata:
base_model: GeneZC/MiniChat-3B
inference: no
model_type: llama
prompt_template: 
 [|User|]\n
{prompt}

[|Assistant|]\n

quantized_by: mwitiderrick
tags: deepsparse