ISTA-DASLab
/

Llama-2-7b-AQLM-2Bit-1x16-hf

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Llama-2-7b-AQLM-2Bit-1x16-hf / modeling_llama_aqlm.py

Commit History

try except flash-attn

f48478c

Andrei Panferov commited on Feb 6, 2024

inference lib

03ea233

Andrei Panferov commited on Jan 28, 2024

new code

dfb8eb3

Andrei Panferov commited on Jan 18, 2024