Missing lm_head.weight

#1
by HERRYDEMO - opened

when load the model, it reports like this
28f07ca7-867f-402e-8f62-3c6398f321fc

Could you report your transformers version? just pip list and reponse with me.

The version of transformers is 5.5.4,as following
10278d2b-ef62-46bd-b71e-d79043316572

Please refer to the transformers version (pip install -U "transformers<5.0"). Our model is based on Qwen2.5-VL.

We also found that this issue was caused by the configuration file being overwritten during training with ms-swift. The transformers 5.x versions are not yet supported/adapted in our current setup.

You can refer to: pip install "transformers<5.0" loguru "qwen-vl-utils" datasets

Sign up or log in to comment