vlmm 0.10.0 load  baidu/ERNIE-4.5-300B-A47B-Base-PT  error
Author: lianghao6
Pull request: no
Labels: name: bug

### System Info

centos 8
python:3.9
transformer: 4.54.0
vllm: 0.10.0
cuda: 12.9


### Reproduction

launch cmd: `vllm serve  $local_model_path   --host *****         --port 8081         --dtype bfloat16         --pipeline-parallel-size 1         --tensor-parallel-size 8         --trust-remote-code         --enable-chunked-prefill         --served-model-name /mnt/hdfs/zw04mlnn01/checkpoint/llm_platform/model/baidu/ERNIE-4.5-300B-A47B-Base-PT/main         --max-model-len 131072         --max-num-batched-tokens 2048         --max-num-seqs 256         --gpu-memory-utilization 0.9         --disable-custom-all-reduce --enable-chunked-prefill`


throw miss some weight, but model itself does not have these weights :
`
WorkerProc failed to start.
[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511] Traceback (most recent call last):

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]   File "/usr/local/lib64/python3.9/site-packages/vllm/v1/executor/multiproc_executor.py", line 485, in worker_main

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]     worker = WorkerProc(*args, **kwargs)

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]   File "/usr/local/lib64/python3.9/site-packages/vllm/v1/executor/multiproc_executor.py", line 382, in __init__

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]     self.worker.load_model()
[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]   File "/usr/local/lib64/python3.9/site-packages/vllm/v1/worker/gpu_worker.py", line 201, in load_model

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]     self.model_runner.load_model(eep_scale_up=eep_scale_up)

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]   File "/usr/local/lib64/python3.9/site-packages/vllm/v1/worker/gpu_model_runner.py", line 1876, in load_model

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]     self.model = model_loader.load_model(
[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]   File "/usr/local/lib64/python3.9/site-packages/vllm/model_executor/model_loader/base_loader.py", line 49, in load_model

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]     self.load_weights(model, model_config)

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]   File "/usr/local/lib64/python3.9/site-packages/vllm/model_executor/model_loader/default_loader.py", line 271, in load_weights

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511]     raise ValueError("Following weights were not initialized from "

[1;36m(VllmWorker rank=3 pid=4867)[0;0m ERROR 07-26 18:47:24 [multiproc_executor.py:511] ValueError: Following weights were not initialized from checkpoint: {'model.layers.19.mlp.shared_experts.gate_up_proj.weight', 'model.layers.37.mlp.shared_experts.gate_up_proj.weight', 'model.layers.31.mlp.shared_experts.down_proj.weight', 'model.layers.44.mlp.shared_experts.gate_up_proj.weight', 'model.layers.41.mlp.shared_experts.down_proj.weight', 'model.layers.46.mlp.shared_experts.gate_up_proj.weight', 'model.layers.48.mlp.shared_experts.gate_up_proj.weight', 'model.layers.33.mlp.shared_experts.gate_up_proj.weight', 'model.layers.39.mlp.shared_experts.gate_up_proj.weight', 'model.layers.10.mlp.shared_experts.gate_up_proj.weight', 'model.layers.26.mlp.shared_experts.down_proj.weight', 'model.layers.11.mlp.shared_experts.gate_up_proj.weight', 'model.layers.47.mlp.shared_experts.down_proj.weight', 'model.layers.46.mlp.shared_experts.down_proj.weight', 'model.layers.6.mlp.shared_experts.down_proj.weight', 'model.layers.32.mlp.shared_experts.down_proj.weight', 'model.layers.43.mlp.shared_experts.gate_up_proj.weight', 'model.layers.27.mlp.shared_experts.gate_up_proj.weight', 'model.layers.17.mlp.shared_experts.gate_up_proj.weight', 'model.layers.19.mlp.shared_experts.down_proj.weight', 'model.layers.32.mlp.shared_experts.gate_up_proj.weight', 'model.layers.16.mlp.shared_experts.gate_up_proj.weight', 'model.layers.29.mlp.shared_experts.gate_up_proj.weight', 'model.layers.52.mlp.shared_experts.gate_up_proj.weight', 'model.layers.25.mlp.shared_experts.gate_up_proj.weight', 'model.layers.20.mlp.shared_experts.gate_up_proj.weight', 'model.layers.17.mlp.shared_experts.down_proj.weight', 'model.layers.50.mlp.shared_experts.down_proj.weight', 'model.layers.53.mlp.shared_experts.down_proj.weight', 'model.layers.45.mlp.shared_experts.down_proj.weight', 'model.layers.4.mlp.shared_experts.down_proj.weight', 'model.layers.3.mlp.shared_experts.down_proj.weight', 'model.layers.12.mlp.shared_experts.down_proj.weight', 'model.layers.12.mlp.shared_experts.gate_up_proj.weight', 'model.layers.37.mlp.shared_experts.down_proj.weight', 'model.layers.51.mlp.shared_experts.down_proj.weight', 'model.layers.20.mlp.shared_experts.down_proj.weight', 'model.layers.34.mlp.shared_experts.down_proj.weight', 'model.layers.35.mlp.shared_experts.gate_up_proj.weight', 'model.layers.18.mlp.shared_experts.gate_up_proj.weight', 'model.layers.38.mlp.shared_experts.gate_up_proj.weight', 'model.layers.27.mlp.shared_experts.down_proj.weight', 'model.layers.38.mlp.shared_experts.down_proj.weight', 'model.layers.34.mlp.shared_experts.gate_up_proj.weight', 'model.layers.42.mlp.shared_experts.down_proj.weight', 'model.layers.23.mlp.shared_experts.gate_up_proj.weight', 'model.layers.5.mlp.shared_experts.down_proj.weight', 'model.layers.35.mlp.shared_experts.down_proj.weight', 'model.layers.23.mlp.shared_experts.down_proj.weight', 'model.layers.40.mlp.shared_experts.down_proj.weight', 'model.layers.45.mlp.shared_experts.gate_up_proj.weight', 'model.layers.21.mlp.shared_experts.down_proj.weight', 'model.layers.39.mlp.shared_experts.down_proj.weight', 'model.layers.14.mlp.shared_experts.gate_up_proj.weight', 'model.layers.48.mlp.shared_experts.down_proj.weight', 'model.layers.41.mlp.shared_experts.gate_up_proj.weight', 'model.layers.10.mlp.shared_experts.down_proj.weight', 'model.layers.22.mlp.shared_experts.gate_up_proj.weight', 'model.layers.30.mlp.shared_experts.down_proj.weight', 'model.layers.47.mlp.shared_experts.gate_up_proj.weight', 'model.layers.24.mlp.shared_experts.down_proj.weight', 'model.layers.13.mlp.shared_experts.down_proj.weight', 'model.layers.15.mlp.shared_experts.down_proj.weight', 'model.layers.25.mlp.shared_experts.down_proj.weight', 'model.layers.29.mlp.shared_experts.down_proj.weight', 'model.layers.22.mlp.shared_experts.down_proj.weight', 'model.layers.7.mlp.shared_experts.down_proj.weight', 'model.layers.44.mlp.shared_experts.down_proj.weight', 'model.layers.52.mlp.shared_experts.down_proj.weight', 'model.layers.7.mlp.shared_experts.gate_up_proj.weight', 'model.layers.42.mlp.shared_experts.gate_up_proj.weight', 'model.layers.14.mlp.shared_experts.down_proj.weight', 'model.layers.8.mlp.shared_experts.gate_up_proj.weight', 'model.layers.51.mlp.shared_experts.gate_up_proj.weight', 'model.layers.5.mlp.shared_experts.gate_up_proj.weight', 'model.layers.30.mlp.shared_experts.gate_up_proj.weight', 'model.layers.36.mlp.shared_experts.down_proj.weight', 'model.layers.13.mlp.shared_experts.gate_up_proj.weight', 'model.layers.53.mlp.shared_experts.gate_up_proj.weight', 'model.layers.31.mlp.shared_experts.gate_up_proj.weight', 'model.layers.49.mlp.shared_experts.gate_up_proj.weight', 'model.layers.4.mlp.shared_experts.gate_up_proj.weight', 'model.layers.49.mlp.shared_experts.down_proj.weight', 'model.layers.24.mlp.shared_experts.gate_up_proj.weight', 'model.layers.11.mlp.shared_experts.down_proj.weight', 'model.layers.26.mlp.shared_experts.gate_up_proj.weight', 'model.layers.3.mlp.shared_experts.gate_up_proj.weight', 'model.layers.9.mlp.shared_experts.gate_up_proj.weight', 'model.layers.50.mlp.shared_experts.gate_up_proj.weight', 'model.layers.28.mlp.shared_experts.gate_up_proj.weight', 'model.layers.6.mlp.shared_experts.gate_up_proj.weight', 'model.layers.16.mlp.shared_experts.down_proj.weight', 'model.layers.15.mlp.shared_experts.gate_up_proj.weight', 'model.layers.9.mlp.shared_experts.down_proj.weight', 'model.layers.28.mlp.shared_experts.down_proj.weight', 'model.layers.8.mlp.shared_experts.down_proj.weight', 'model.layers.36.mlp.shared_experts.gate_up_proj.weight', 'model.layers.40.mlp.shared_experts.gate_up_proj.weight', 'model.layers.43.mlp.shared_experts.down_proj.weight', 'model.layers.33.mlp.shared_experts.down_proj.weight', 'model.layers.21.mlp.shared_experts.gate_up_proj.weight', 'model.layers.18.mlp.shared_experts.down_proj.weight'}
`


### Expected behavior

Why are some weights that are not included in the model configuration thrown out

Comments: