KeyError: 'transformer.h.26.input_layernorm.weight'
#5
by
Mabeck
- opened
This may be a vLLM specific issue, but I get the following error when trying to load.
File "/zhome/55/8/206247/scandenv/lib/python3.10/site-packages/vllm/model_executor/models/falcon.py", line 421, in load_weights
param = params_dict[name]
KeyError: 'transformer.h.26.input_layernorm.weight'
Hi! We have not yet worked on the vLLM code. The main branch of transformers should be able to load the model.
nilabhra
changed discussion status to
closed