casperhansen
/

mpt-7b-8k-chat-awq-gemv

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mpt-7b-8k-chat-awq-gemv / awq_model_w4_g128.pt

Commit History

initial

ede1189

casperhansen commited on Sep 9, 2023