Qwen3_Omni error inference transformer 4.57.0.dev
Author: Tortoise17
Pull request: no
Labels: name: bug

### System Info

There is inference demo from the qwen_omni following the command 

`https://github.com/QwenLM/Qwen3-Omni/blob/main/web_demo.py`

and below is error. 
Trnasformer version is 4.57.0.dev directly cloned and installed. 
and model used have been below 

`https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct`

and the resultant error is below. 

```

model = LLM(
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 282, in __init__
[rank0]:     self.llm_engine = LLMEngine.from_engine_args(
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 493, in from_engine_args
[rank0]:     return engine_cls.from_vllm_config(
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 469, in from_vllm_config
[rank0]:     return cls(
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 260, in __init__
[rank0]:     self.model_executor = executor_class(vllm_config=vllm_config)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/executor/executor_base.py", line 264, in __init__
[rank0]:     super().__init__(*args, **kwargs)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/executor/executor_base.py", line 54, in __init__
[rank0]:     self._init_executor()
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/executor/mp_distributed_executor.py", line 126, in _init_executor
[rank0]:     self._run_workers("load_model",
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/executor/mp_distributed_executor.py", line 186, in _run_workers
[rank0]:     driver_worker_output = run_method(self.driver_worker, sent_method,
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/utils/__init__.py", line 3060, in run_method
[rank0]:     return func(*args, **kwargs)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/worker/worker.py", line 211, in load_model
[rank0]:     self.model_runner.load_model()
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/worker/model_runner.py", line 1054, in load_model
[rank0]:     self.model = get_model(vllm_config=self.vllm_config)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/model_loader/__init__.py", line 119, in get_model
[rank0]:     return loader.load_model(vllm_config=vllm_config,
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/model_loader/base_loader.py", line 45, in load_model
[rank0]:     model = initialize_model(vllm_config=vllm_config,
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/model_loader/utils.py", line 64, in initialize_model
[rank0]:     return model_class(vllm_config=vllm_config, prefix=prefix)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/compilation/decorators.py", line 199, in __init__
[rank0]:     old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/models/transformers.py", line 792, in __init__
[rank0]:     super().__init__(vllm_config=vllm_config, prefix=prefix)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/compilation/decorators.py", line 199, in __init__
[rank0]:     old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/models/transformers.py", line 707, in __init__
[rank0]:     super().__init__(vllm_config=vllm_config, prefix=prefix)
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/models/transformers.py", line 462, in __init__
[rank0]:     self.model: PreTrainedModel = AutoModel.from_config(
[rank0]:   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 243, in from_config
[rank0]:     raise ValueError(
[rank0]: ValueError: Unrecognized configuration class <class 'transformers.models.qwen3_omni_moe.configuration_qwen3_omni_moe.Qwen3OmniMoeConfig'> for this kind of AutoModel: AutoModel.
[rank0]: Model type should be one of Aimv2Config, Aimv2VisionConfig, AlbertConfig, AlignConfig, AltCLIPConfig, ApertusConfig, ArceeConfig, AriaConfig, AriaTextConfig, ASTConfig, AutoformerConfig, AyaVisionConfig, BambaConfig, BarkConfig, BartConfig, BeitConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BitConfig, BitNetConfig, BlenderbotConfig, BlenderbotSmallConfig, BlipConfig, Blip2Config, Blip2QFormerConfig, BloomConfig, BltConfig, BridgeTowerConfig, BrosConfig, CamembertConfig, CanineConfig, ChameleonConfig, ChineseCLIPConfig, ChineseCLIPVisionConfig, ClapConfig, CLIPConfig, CLIPTextConfig, CLIPVisionConfig, CLIPSegConfig, ClvpConfig, LlamaConfig, CodeGenConfig, CohereConfig, Cohere2Config, Cohere2VisionConfig, ConditionalDetrConfig, ConvBertConfig, ConvNextConfig, ConvNextV2Config, CpmAntConfig, CsmConfig, CTRLConfig, CvtConfig, DFineConfig, DabDetrConfig, DacConfig, Data2VecAudioConfig, Data2VecTextConfig, Data2VecVisionConfig, DbrxConfig, DebertaConfig, DebertaV2Config, DecisionTransformerConfig, DeepseekV2Config, DeepseekV3Config, DeepseekVLConfig, DeepseekVLHybridConfig, DeformableDetrConfig, DeiTConfig, DepthProConfig, DetaConfig, DetrConfig, DiaConfig, DiffLlamaConfig, DinatConfig, Dinov2Config, Dinov2WithRegistersConfig, DINOv3ConvNextConfig, DINOv3ViTConfig, DistilBertConfig, DogeConfig, DonutSwinConfig, Dots1Config, DPRConfig, DPTConfig, EfficientFormerConfig, EfficientLoFTRConfig, EfficientNetConfig, ElectraConfig, Emu3Config, EncodecConfig, ErnieConfig, Ernie4_5Config, Ernie4_5_MoeConfig, ErnieMConfig, EsmConfig, EvollaConfig, Exaone4Config, FalconConfig, FalconH1Config, FalconMambaConfig, FastSpeech2ConformerConfig, FastSpeech2ConformerWithHifiGanConfig, FlaubertConfig, FlavaConfig, FlexOlmoConfig, Florence2Config, FNetConfig, FocalNetConfig, FSMTConfig, FunnelConfig, FuyuConfig, GemmaConfig, Gemma2Config, Gemma3Config, Gemma3TextConfig, Gemma3nConfig, Gemma3nAudioConfig, Gemma3nTextConfig, Gemma3nVisionConfig, GitConfig, GlmConfig, Glm4Config, Glm4MoeConfig, Glm4vConfig, Glm4vMoeConfig, Glm4vMoeTextConfig, Glm4vTextConfig, GLPNConfig, GotOcr2Config, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GptOssConfig, GPTJConfig, GPTSanJapaneseConfig, GraniteConfig, GraniteMoeConfig, GraniteMoeHybridConfig, GraniteMoeSharedConfig, GraphormerConfig, GroundingDinoConfig, GroupViTConfig, HeliumConfig, HGNetV2Config, HieraConfig, HubertConfig, HunYuanDenseV1Config, HunYuanMoEV1Config, IBertConfig, IdeficsConfig, Idefics2Config, Idefics3Config, Idefics3VisionConfig, IJepaConfig, ImageGPTConfig, InformerConfig, InstructBlipConfig, InstructBlipVideoConfig, InternVLConfig, InternVLVisionConfig, JambaConfig, JanusConfig, JetMoeConfig, JukeboxConfig, Kosmos2Config, Kosmos2_5Config, KyutaiSpeechToTextConfig, LayoutLMConfig, LayoutLMv2Config, LayoutLMv3Config, LEDConfig, LevitConfig, Lfm2Config, Lfm2VlConfig, LightGlueConfig, LiltConfig, LlamaConfig, Llama4Config, Llama4TextConfig, LlavaConfig, LlavaNextConfig, LlavaNextVideoConfig, LlavaOnevisionConfig, LongcatFlashConfig, LongformerConfig, LongT5Config, LukeConfig, LxmertConfig, M2M100Config, MambaConfig, Mamba2Config, MarianConfig, MarkupLMConfig, Mask2FormerConfig, MaskFormerConfig, MaskFormerSwinConfig, MBartConfig, MCTCTConfig, MegaConfig, MegatronBertConfig, MetaClip2Config, MgpstrConfig, MimiConfig, MiniMaxConfig, MinistralConfig, MistralConfig, Mistral3Config, MixtralConfig, MLCDVisionConfig, MllamaConfig, MMGroundingDinoConfig, MobileBertConfig, MobileNetV1Config, MobileNetV2Config, MobileViTConfig, MobileViTV2Config, ModernBertConfig, ModernBertDecoderConfig, MoonshineConfig, MoshiConfig, MPNetConfig, MptConfig, MraConfig, MT5Config, MusicgenConfig, MusicgenMelodyConfig, MvpConfig, NatConfig, NemotronConfig, NezhaConfig, NllbMoeConfig, NystromformerConfig, OlmoConfig, Olmo2Config, Olmo3Config, OlmoeConfig, OmDetTurboConfig, OneFormerConfig, OpenLlamaConfig, OpenAIGPTConfig, OPTConfig, Ovis2Config, Owlv2Config, OwlViTConfig, PaliGemmaConfig, ParakeetCTCConfig, ParakeetEncoderConfig, PatchTSMixerConfig, PatchTSTConfig, PegasusConfig, PegasusXConfig, PerceiverConfig, TimmWrapperConfig, PerceptionLMConfig, PersimmonConfig, PhiConfig, Phi3Config, Phi4MultimodalConfig, PhimoeConfig, PixtralVisionConfig, PLBartConfig, PoolFormerConfig, ProphetNetConfig, PvtConfig, PvtV2Config, QDQBertConfig, Qwen2Config, Qwen2_5_VLConfig, Qwen2_5_VLTextConfig, Qwen2AudioEncoderConfig, Qwen2MoeConfig, Qwen2VLConfig, Qwen2VLTextConfig, Qwen3Config, Qwen3MoeConfig, Qwen3NextConfig, Qwen3VLConfig, Qwen3VLMoeConfig, Qwen3VLMoeTextConfig, Qwen3VLTextConfig, RecurrentGemmaConfig, ReformerConfig, RegNetConfig, RemBertConfig, ResNetConfig, RetriBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RTDetrConfig, RTDetrV2Config, RwkvConfig, SamConfig, Sam2Config, Sam2HieraDetConfig, Sam2VideoConfig, Sam2VisionConfig, SamHQConfig, SamHQVisionConfig, SamVisionConfig, SeamlessM4TConfig, SeamlessM4Tv2Config, SeedOssConfig, SegformerConfig, SegGptConfig, SEWConfig, SEWDConfig, SiglipConfig, Siglip2Config, Siglip2VisionConfig, SiglipVisionConfig, SmolLM3Config, SmolVLMConfig, SmolVLMVisionConfig, Speech2TextConfig, SpeechT5Config, SplinterConfig, SqueezeBertConfig, StableLmConfig, Starcoder2Config, SwiftFormerConfig, SwinConfig, Swin2SRConfig, Swinv2Config, SwitchTransformersConfig, T5Config, T5GemmaConfig, TableTransformerConfig, TapasConfig, TextNetConfig, TimeSeriesTransformerConfig, TimesFmConfig, TimesformerConfig, TimmBackboneConfig, TimmWrapperConfig, TrajectoryTransformerConfig, TransfoXLConfig, TvltConfig, TvpConfig, UdopConfig, UMT5Config, UniSpeechConfig, UniSpeechSatConfig, UnivNetConfig, VanConfig, VaultGemmaConfig, VideoLlavaConfig, VideoMAEConfig, ViltConfig, VipLlavaConfig, VisionTextDualEncoderConfig, VisualBertConfig, ViTConfig, ViTHybridConfig, ViTMAEConfig, ViTMSNConfig, VitDetConfig, VitsConfig, VivitConfig, VJEPA2Config, VoxtralConfig, VoxtralEncoderConfig, Wav2Vec2Config, Wav2Vec2BertConfig, Wav2Vec2ConformerConfig, WavLMConfig, WhisperConfig, XCLIPConfig, XcodecConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, xLSTMConfig, XmodConfig, YolosConfig, YosoConfig, ZambaConfig, Zamba2Config.
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232] Exception in worker VllmWorkerProcess while processing method load_model.
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232] Traceback (most recent call last):
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/executor/multiproc_worker_utils.py", line 226, in _run_worker_process
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     output = run_method(worker, method, args, kwargs)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/utils/__init__.py", line 3060, in run_method
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     return func(*args, **kwargs)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/worker/worker.py", line 211, in load_model
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     self.model_runner.load_model()
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/worker/model_runner.py", line 1054, in load_model
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     self.model = get_model(vllm_config=self.vllm_config)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/model_loader/__init__.py", line 119, in get_model
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     return loader.load_model(vllm_config=vllm_config,
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/model_loader/base_loader.py", line 45, in load_model
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     model = initialize_model(vllm_config=vllm_config,
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/model_loader/utils.py", line 64, in initialize_model
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     return model_class(vllm_config=vllm_config, prefix=prefix)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/compilation/decorators.py", line 199, in __init__
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/models/transformers.py", line 792, in __init__
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     super().__init__(vllm_config=vllm_config, prefix=prefix)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/compilation/decorators.py", line 199, in __init__
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     old_init(self, vllm_config=vllm_config, prefix=prefix, **kwargs)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/models/transformers.py", line 707, in __init__
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     super().__init__(vllm_config=vllm_config, prefix=prefix)
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/vllm/model_executor/models/transformers.py", line 462, in __init__
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     self.model: PreTrainedModel = AutoModel.from_config(
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]   File "/home/user/allwork/envs/omni3/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 243, in from_config
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232]     raise ValueError(
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232] ValueError: Unrecognized configuration class <class 'transformers.models.qwen3_omni_moe.configuration_qwen3_omni_moe.Qwen3OmniMoeConfig'> for this kind of AutoModel: AutoModel.
(VllmWorkerProcess pid=3725040) ERROR 09-30 11:01:18 [multiproc_worker_utils.py:232] Model type should be one of Aimv2Config, Aimv2VisionConfig, AlbertConfig, AlignConfig, AltCLIPConfig, ApertusConfig, ArceeConfig, AriaConfig, AriaTextConfig, ASTConfig, AutoformerConfig, AyaVisionConfig, BambaConfig, BarkConfig, BartConfig, BeitConfig, BertConfig, BertGenerationConfig, BigBirdConfig, BigBirdPegasusConfig, BioGptConfig, BitConfig, BitNetConfig, BlenderbotConfig, BlenderbotSmallConfig, BlipConfig, Blip2Config, Blip2QFormerConfig, BloomConfig, BltConfig, BridgeTowerConfig, BrosConfig, CamembertConfig, CanineConfig, ChameleonConfig, ChineseCLIPConfig, ChineseCLIPVisionConfig, ClapConfig, CLIPConfig, CLIPTextConfig, CLIPVisionConfig, CLIPSegConfig, ClvpConfig, LlamaConfig, CodeGenConfig, CohereConfig, Cohere2Config, Cohere2VisionConfig, ConditionalDetrConfig, ConvBertConfig, ConvNextConfig, ConvNextV2Config, CpmAntConfig, CsmConfig, CTRLConfig, CvtConfig, DFineConfig, DabDetrConfig, DacConfig, Data2VecAudioConfig, Data2VecTextConfig, Data2VecVisionConfig, DbrxConfig, DebertaConfig, DebertaV2Config, DecisionTransformerConfig, DeepseekV2Config, DeepseekV3Config, DeepseekVLConfig, DeepseekVLHybridConfig, DeformableDetrConfig, DeiTConfig, DepthProConfig, DetaConfig, DetrConfig, DiaConfig, DiffLlamaConfig, DinatConfig, Dinov2Config, Dinov2WithRegistersConfig, DINOv3ConvNextConfig, DINOv3ViTConfig, DistilBertConfig, DogeConfig, DonutSwinConfig, Dots1Config, DPRConfig, DPTConfig, EfficientFormerConfig, EfficientLoFTRConfig, EfficientNetConfig, ElectraConfig, Emu3Config, EncodecConfig, ErnieConfig, Ernie4_5Config, Ernie4_5_MoeConfig, ErnieMConfig, EsmConfig, EvollaConfig, Exaone4Config, FalconConfig, FalconH1Config, FalconMambaConfig, FastSpeech2ConformerConfig, FastSpeech2ConformerWithHifiGanConfig, FlaubertConfig, FlavaConfig, FlexOlmoConfig, Florence2Config, FNetConfig, FocalNetConfig, FSMTConfig, FunnelConfig, FuyuConfig, GemmaConfig, Gemma2Config, Gemma3Config, Gemma3TextConfig, Gemma3nConfig, Gemma3nAudioConfig, Gemma3nTextConfig, Gemma3nVisionConfig, GitConfig, GlmConfig, Glm4Config, Glm4MoeConfig, Glm4vConfig, Glm4vMoeConfig, Glm4vMoeTextConfig, Glm4vTextConfig, GLPNConfig, GotOcr2Config, GPT2Config, GPT2Config, GPTBigCodeConfig, GPTNeoConfig, GPTNeoXConfig, GPTNeoXJapaneseConfig, GptOssConfig, GPTJConfig, GPTSanJapaneseConfig, GraniteConfig, GraniteMoeConfig, GraniteMoeHybridConfig, GraniteMoeSharedConfig, GraphormerConfig, GroundingDinoConfig, GroupViTConfig, HeliumConfig, HGNetV2Config, HieraConfig, HubertConfig, HunYuanDenseV1Config, HunYuanMoEV1Config, IBertConfig, IdeficsConfig, Idefics2Config, Idefics3Config, Idefics3VisionConfig, IJepaConfig, ImageGPTConfig, InformerConfig, InstructBlipConfig, InstructBlipVideoConfig, InternVLConfig, InternVLVisionConfig, JambaConfig, JanusConfig, JetMoeConfig, JukeboxConfig, Kosmos2Config, Kosmos2_5Config, KyutaiSpeechToTextConfig, LayoutLMConfig, LayoutLMv2Config, LayoutLMv3Config, LEDConfig, LevitConfig, Lfm2Config, Lfm2VlConfig, LightGlueConfig, LiltConfig, LlamaConfig, Llama4Config, Llama4TextConfig, LlavaConfig, LlavaNextConfig, LlavaNextVideoConfig, LlavaOnevisionConfig, LongcatFlashConfig, LongformerConfig, LongT5Config, LukeConfig, LxmertConfig, M2M100Config, MambaConfig, Mamba2Config, MarianConfig, MarkupLMConfig, Mask2FormerConfig, MaskFormerConfig, MaskFormerSwinConfig, MBartConfig, MCTCTConfig, MegaConfig, MegatronBertConfig, MetaClip2Config, MgpstrConfig, MimiConfig, MiniMaxConfig, MinistralConfig, MistralConfig, Mistral3Config, MixtralConfig, MLCDVisionConfig, MllamaConfig, MMGroundingDinoConfig, MobileBertConfig, MobileNetV1Config, MobileNetV2Config, MobileViTConfig, MobileViTV2Config, ModernBertConfig, ModernBertDecoderConfig, MoonshineConfig, MoshiConfig, MPNetConfig, MptConfig, MraConfig, MT5Config, MusicgenConfig, MusicgenMelodyConfig, MvpConfig, NatConfig, NemotronConfig, NezhaConfig, NllbMoeConfig, NystromformerConfig, OlmoConfig, Olmo2Config, Olmo3Config, OlmoeConfig, OmDetTurboConfig, OneFormerConfig, OpenLlamaConfig, OpenAIGPTConfig, OPTConfig, Ovis2Config, Owlv2Config, OwlViTConfig, PaliGemmaConfig, ParakeetCTCConfig, ParakeetEncoderConfig, PatchTSMixerConfig, PatchTSTConfig, PegasusConfig, PegasusXConfig, PerceiverConfig, TimmWrapperConfig, PerceptionLMConfig, PersimmonConfig, PhiConfig, Phi3Config, Phi4MultimodalConfig, PhimoeConfig, PixtralVisionConfig, PLBartConfig, PoolFormerConfig, ProphetNetConfig, PvtConfig, PvtV2Config, QDQBertConfig, Qwen2Config, Qwen2_5_VLConfig, Qwen2_5_VLTextConfig, Qwen2AudioEncoderConfig, Qwen2MoeConfig, Qwen2VLConfig, Qwen2VLTextConfig, Qwen3Config, Qwen3MoeConfig, Qwen3NextConfig, Qwen3VLConfig, Qwen3VLMoeConfig, Qwen3VLMoeTextConfig, Qwen3VLTextConfig, RecurrentGemmaConfig, ReformerConfig, RegNetConfig, RemBertConfig, ResNetConfig, RetriBertConfig, RobertaConfig, RobertaPreLayerNormConfig, RoCBertConfig, RoFormerConfig, RTDetrConfig, RTDetrV2Config, RwkvConfig, SamConfig, Sam2Config, Sam2HieraDetConfig, Sam2VideoConfig, Sam2VisionConfig, SamHQConfig, SamHQVisionConfig, SamVisionConfig, SeamlessM4TConfig, SeamlessM4Tv2Config, SeedOssConfig, SegformerConfig, SegGptConfig, SEWConfig, SEWDConfig, SiglipConfig, Siglip2Config, Siglip2VisionConfig, SiglipVisionConfig, SmolLM3Config, SmolVLMConfig, SmolVLMVisionConfig, Speech2TextConfig, SpeechT5Config, SplinterConfig, SqueezeBertConfig, StableLmConfig, Starcoder2Config, SwiftFormerConfig, SwinConfig, Swin2SRConfig, Swinv2Config, SwitchTransformersConfig, T5Config, T5GemmaConfig, TableTransformerConfig, TapasConfig, TextNetConfig, TimeSeriesTransformerConfig, TimesFmConfig, TimesformerConfig, TimmBackboneConfig, TimmWrapperConfig, TrajectoryTransformerConfig, TransfoXLConfig, TvltConfig, TvpConfig, UdopConfig, UMT5Config, UniSpeechConfig, UniSpeechSatConfig, UnivNetConfig, VanConfig, VaultGemmaConfig, VideoLlavaConfig, VideoMAEConfig, ViltConfig, VipLlavaConfig, VisionTextDualEncoderConfig, VisualBertConfig, ViTConfig, ViTHybridConfig, ViTMAEConfig, ViTMSNConfig, VitDetConfig, VitsConfig, VivitConfig, VJEPA2Config, VoxtralConfig, VoxtralEncoderConfig, Wav2Vec2Config, Wav2Vec2BertConfig, Wav2Vec2ConformerConfig, WavLMConfig, WhisperConfig, XCLIPConfig, XcodecConfig, XGLMConfig, XLMConfig, XLMProphetNetConfig, XLMRobertaConfig, XLMRobertaXLConfig, XLNetConfig, xLSTMConfig, XmodConfig, YolosConfig, YosoConfig, ZambaConfig, Zamba2Config.
ERROR 09-30 11:01:18 [multiproc_worker_utils.py:116] Worker VllmWorkerProcess pid 3725040 died, exit code: -15
INFO 09-30 11:01:18 [multiproc_worker_utils.py:120] Killing local vLLM worker processes
[rank0]:[W930 11:01:19.644779911 ProcessGroupNCCL.cpp:1538] Warning: WARNING: destroy_process_group() was not called before program exit, which can leak resources. For more info, please see https://pytorch.org/docs/stable/distributed.html#shutdown (function operator())
/home/user/allwork/envs/omni3/lib/python3.10/multiprocessing/resource_tracker.py:224: UserWarning: resource_tracker: There appear to be 1 leaked shared_memory objects to clean up at shutdown
  warnings.warn('resource_tracker: There appear to be %d '


```

### Who can help?

_No response_

### Information

- [x] The official example scripts
- [ ] My own modified scripts

### Tasks

- [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
- [ ] My own task or dataset (give details below)

### Reproduction

Creating env name with python 3.10
Installing envs, 
Installing recent available transformers from git
Downloading the `https://huggingface.co/Qwen/Qwen3-Omni-30B-A3B-Instruct` locally 
Providing path of the model locally available in `web_demo.py` file
While in the envs
`python web_demo.py`

and below is error. 

### Expected behavior

Executing the correct version and should run locally 
like below 

`https://huggingface.co/spaces/Qwen/Qwen2.5-Omni-7B-Demo`

Comments:
Is it solved?

@ZHUXUHAN Yes, so far it started working now from yesterdays commits. THank you. I am closing the issue now.