ISTA-DASLab
/

Meta-Llama-3-8B-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-8B-AQLM-2Bit-1x16 / config.json

Commit History

Uploaded improved version of quantized model

e7dfbbd
verified

SpiridonSunRotator commited on May 2

Uploaded Meta-Llama-3-8B with AQLM 1x16 quantization

764d77a
verified

SpiridonSunRotator commited on Apr 23