Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.

#2
by chuangzhidian - opened

Unused kwargs: ['_load_in_4bit', '_load_in_8bit', 'quant_method']. These kwargs are not used in <class 'transformers.utils.quantization_config.BitsAndBytesConfig'>.
运行时出现这个,不知道怎么解决

Knowledge Engineering Group (KEG) & Data Mining at Tsinghua University org

用4.40的transformer

zRzRzRzRzRzRzR changed discussion status to closed

Sign up or log in to comment