had upgraded transformer==4.37.0, the error "KeyError: 'qwen2'" becomes "qwen2 isn't suported yet"

#1
by sdwcn - opened

had upgraded transformer==4.37.0, the error "KeyError: 'qwen2'" becomes "qwen2 isn't suported yet"

Any missing requirement not satisfied?

Traceback (most recent call last):
File "/text-generation-webui/modules/ui_model_menu.py", line 213, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/text-generation-webui/modules/models.py", line 87, in load_model
output = load_func_maploader
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/text-generation-webui/modules/models.py", line 311, in AutoAWQ_loader
model = AutoAWQForCausalLM.from_quantized(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/text-generation-webui/installer_files/env/lib/python3.11/site-packages/awq/models/auto.py", line 54, in from_quantized
model_type = check_and_get_model_type(quant_path, trust_remote_code)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/text-generation-webui/installer_files/env/lib/python3.11/site-packages/awq/models/auto.py", line 29, in check_and_get_model_type
raise TypeError(f"{config.model_type} isn't supported yet.")
TypeError: qwen2 isn't supported yet.

Qwen org

auto-awq>=0.2.0

Sign up or log in to comment