Hugging Face model: adamrb/mpt-30b-chat-w8a8-gptq
Author: adamrb
Created: 2025-07-15 17:51:29
Last modified: 2025-07-15 18:46:17
Likes: 0 | Downloads: 6
Tags: safetensors, mpt, Composer, MosaicML, llm-foundry, gptq, quantized, 8bit, w8a8, dataset:camel-ai/code, dataset:ehartford/wizard_vicuna_70k_unfiltered, dataset:anon8231489123/ShareGPT_Vicuna_unfiltered, dataset:timdettmers/openassistant-guanaco, dataset:camel-ai/math, dataset:camel-ai/biology, dataset:camel-ai/chemistry, dataset:camel-ai/ai_society, dataset:jondurbin/airoboros-gpt4-1.2, dataset:LongConversations, dataset:camel-ai/physics, arxiv:2205.14135, arxiv:2108.12409, arxiv:2210.17323, base_model:mosaicml/mpt-30b-chat, base_model:quantized:mosaicml/mpt-30b-chat, license:cc-by-nc-sa-4.0, 8-bit, region:us
Base model relation: quantized
Base models: id: mosaicml/mpt-30b-chat
Card metadata:
license: cc-by-nc-sa-4.0
datasets: camel-ai/code, ehartford/wizard_vicuna_70k_unfiltered, anon8231489123/ShareGPT_Vicuna_unfiltered, timdettmers/openassistant-guanaco, camel-ai/math, camel-ai/biology, camel-ai/chemistry, camel-ai/ai_society, jondurbin/airoboros-gpt4-1.2, LongConversations, camel-ai/physics
tags: Composer, MosaicML, llm-foundry, gptq, quantized, 8bit, w8a8
base_model: mosaicml/mpt-30b-chat
quantized_by: adamrb
inference: yes