Hugging Face model: TheBloke/SciPhi-Mistral-7B-32k-AWQ
Author: TheBloke
Created: 2023-10-29 21:52:43
Last modified: 2023-11-09 18:16:24
Pipeline: text-generation
Library: transformers
Likes: 4 | Downloads: 7
Tags: transformers, safetensors, mistral, text-generation, arxiv:2306.02707, arxiv:2301.13688, base_model:SciPhi/SciPhi-Mistral-7B-32k, base_model:quantized:SciPhi/SciPhi-Mistral-7B-32k, text-generation-inference, 4-bit, awq, region:us
Base model relation: quantized
Base models: id: SciPhi/SciPhi-Mistral-7B-32k
Card metadata:
base_model: SciPhi/SciPhi-Mistral-7B-32k
inference: no
model_creator: SciPhi
model_name: SciPhi Mistral 7B 32K
model_type: mistral
prompt_template: {prompt}

quantized_by: TheBloke