KeyError: 'transformer.h.26.input_layernorm.weight'

#5
by Mabeck - opened

This may be a vLLM specific issue, but I get the following error when trying to load.

  File "/zhome/55/8/206247/scandenv/lib/python3.10/site-packages/vllm/model_executor/models/falcon.py", line 421, in load_weights
    param = params_dict[name]
KeyError: 'transformer.h.26.input_layernorm.weight'

Hi! We have not yet worked on the vLLM code. The main branch of transformers should be able to load the model.

nilabhra changed discussion status to closed

I've opened a request on Github to add the model.

Sign up or log in to comment