ISTA-DASLab
/

Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16 / model.safetensors

Commit History

Uploaded improved version of quantized model

c688054
verified

SpiridonSunRotator commited on May 2

Uploaded Meta-Llama-3-8B-Instruct with AQLM 1x16 quantization

2c4df03
verified

SpiridonSunRotator commited on Apr 21