ISTA-DASLab
/

Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

Commit History

Uploaded Meta-Llama-3-8B-Instruct with AQLM 1x16 quantization

2c4df03
verified

SpiridonSunRotator commited on Apr 21

initial commit

ce10727
verified

SpiridonSunRotator commited on Apr 21