fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym

Text Generation

intel-autoround

text-generation-inference

4-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym

File size: 135 Bytes

7201c68

version https://git-lfs.github.com/spec/v1
oid sha256:ad7416babc565cc1f37ae715215a9d32ed5a907677b4035ef65f0186d65c4198
size 2842493440