Hugging Face's logo

CorticalStack
/
mistral-7b-metamathqa-gptq

Text Generation
Transformers
Safetensors
mistral
text-generation-inference
Inference Endpoints
4-bit precision
gptq
Model card Files Community
mistral-7b-metamathqa-gptq / README.md
CorticalStack's picture
CorticalStack
Upload folder using huggingface_hub
0c045dd verified
preview code
|
raw
history blame contribute delete
No virus
757 Bytes
metadata
license: apache-2.0

CorticalStack/mistral-7b-metamathqa-gptq

CorticalStack/mistral-7b-metamathqa-gptq is an GPTQ quantised version of CorticalStack/mistral-7b-metamathqa-sft.

GPTQ models are currently supported on Linux (NVidia/AMD) and Windows (NVidia only). MacOS users: please use GGUF models.

These GPTQ models are known to work in the following inference servers/webuis.