Model: RedHatAI/zephyr-7b-beta-pruned50-quant-ds
Author: RedHatAI
Pipeline: text-generation
Library: transformers
Tags: transformers, onnx, mistral, text-generation, deepsparse, conversational, arxiv:2301.00774, base_model:HuggingFaceH4/zephyr-7b-beta, base_model:quantized:HuggingFaceH4/zephyr-7b-beta, region:us
Base models (quantized): id: HuggingFaceH4/zephyr-7b-beta
Card metadata: base_model: HuggingFaceH4/zephyr-7b-beta
inference: no
model_type: mistral
prompt_template: ### Instruction:\n
{prompt}
### Response:\n

quantized_by: mwitiderrick
tags: deepsparse
Likes: 0 | All-time downloads: 270
Created: 2023-10-28 22:42:52