casperhansen
/

mpt-7b-8k-chat-awq-gemv

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

mpt-7b-8k-chat-awq-gemv / flash_attn_triton.py

Commit History

initial

ede1189

casperhansen commited on Sep 9, 2023