CorticalStack/mistral-7b-metamathqa-gptq

CorticalStack/mistral-7b-metamathqa-gptq is an GPTQ quantised version of CorticalStack/mistral-7b-metamathqa-sft.

GPTQ models are currently supported on Linux (NVidia/AMD) and Windows (NVidia only). MacOS users: please use GGUF models.

These GPTQ models are known to work in the following inference servers/webuis.

• text-generation-webui
• KoboldAI United
• LoLLMS Web UI
• Hugging Face Text Generation Inference (TGI)