fbaldassarri
/

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym

Text Generation

intel-autoround

text-generation-inference

4-bit precision

Model card Files Files and versions Community

meta-llama_Llama-3.1-8B-Instruct-auto_awq-int4-gs128-asym

1 contributor

History: 2 commits

fbaldassarri's picture

Initial Upload

7201c68 verified 20 days ago