Hugging Face model: RedHatAI/zephyr-7b-beta-pruned50-quant-ds
Author: RedHatAI
Created: 2023-10-28 22:42:52
Last modified: 2024-01-09 15:39:33
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 6
Tags: transformers, onnx, mistral, text-generation, deepsparse, conversational, arxiv:2301.00774, base_model:HuggingFaceH4/zephyr-7b-beta, base_model:quantized:HuggingFaceH4/zephyr-7b-beta, region:us
Base model relation: quantized
Base models: id: HuggingFaceH4/zephyr-7b-beta
Card metadata:
base_model: HuggingFaceH4/zephyr-7b-beta
inference: no
model_type: mistral
prompt_template: ### Instruction:\n
{prompt}
### Response:\n

quantized_by: mwitiderrick
tags: deepsparse