OPEA
/

Meta-Llama-3.1-70B-Instruct-int4-sym-inc

4-bit precision

intel/auto-round

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-int4-sym-inc / generation_config.json

Commit History

add autogptq format

90c15db

wenhuach commited on Nov 30, 2024