[`Ernie 4.5`] Ernie VL models
Author: vasqu
Pull request: yes
Labels: name: New model

Continuation of #39228 for the VL models

Current inference script for testing (torch 2.9.1):
```python
import requests
from PIL import Image

from transformers import AutoConfig, AutoModelForImageTextToText, AutoProcessor


model_path = "/raid/anton/code/forks/transformers/AntonV/ErnieVL"
processor = AutoProcessor.from_pretrained(model_path)

config = AutoConfig.from_pretrained(model_path)
model = AutoModelForImageTextToText.from_pretrained(
    "baidu/ERNIE-4.5-VL-28B-A3B-PT",
    config=config,
    device_map="auto",
    dtype="auto",
)

messages = [
    {
        "role": "user",
        "content": [
            {"type": "text", "text": "Only use English during your responses and describe the following image."},
            {"type": "image"},
        ]
    },
]
text = processor.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
image = Image.open(requests.get("https://paddlenlp.bj.bcebos.com/datasets/paddlemix/demo_images/example1.jpg", stream=True).raw)
inputs = processor(text=[text], images=[image], return_tensors="pt").to(model.device)

generated_ids = model.generate(
    **inputs,
    max_new_tokens=64,
    do_sample=False,
)
print(processor.decode(generated_ids[0][len(inputs['input_ids'][0]):]))
```
Output: 
`The image features a scenic view of rolling mountains under a clear sky. In the foreground, there is a person sitting on a hillside, facing away from the camera. The person is wrapped in a colorful, striped blanket. The landscape is dotted with vibrant pink flowers, adding a pop of color to the`

Left TODOs:
- [x] TP
  - [ ] EP to add later after its been fixed 

Comments:
The docs for this PR live [here](https://moon-ci-docs.huggingface.co/docs/transformers/pr_39585). All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

There are some TODOs left, but the core parts are finished so a general (first) review would be nice 

run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20279197557)

✅ No failing test specific to this PR 🎉 !


run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20281807905)

✅ No failing test specific to this PR 🎉 !


run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20311435378)

✅ No failing test specific to this PR 🎉 !


run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20368185061)

### Model CI Report

#### ❌ Failed tests

- [ernie4_5_vl_moe](https://github.com/huggingface/transformers/actions/runs/20368185061/job/58528536891):
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeModelTest::test_init_weights_can_init_buffers
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeSmallIntegrationTest::test_small_model_integration_test
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeSmallIntegrationTest::test_small_model_integration_test_batch
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeSmallIntegrationTest::test_small_model_integration_test_batch_different_resolutions
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeSmallIntegrationTest::test_small_model_integration_test_batch_wo_image



run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20375489555)

### Model CI Report

#### ❌ Failed tests

- [ernie4_5_vl_moe](https://github.com/huggingface/transformers/actions/runs/20375489555/job/58553450832):
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeModelTest::test_all_tensors_are_parameter_or_buffer



run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20376409166)

### Model CI Report

#### ❌ Failed tests

- [ernie4_5_vl_moe](https://github.com/huggingface/transformers/actions/runs/20376409166/job/58556127790):
    tests/models/ernie4_5_vl_moe/test_modeling_ernie4_5_vl_moe.py::Ernie4_5_VL_MoeModelTest::test_all_tensors_are_parameter_or_buffer



run-slow: ernie4_5_vl_moe

This comment contains `run-slow`, running the specified jobs: 

models: ["models/ernie4_5_vl_moe"]
quantizations: []

## CI Results
[Workflow Run ⚙️](https://github.com/huggingface/transformers/actions/runs/20376921879)

✅ No failing test specific to this PR 🎉 !


**[For maintainers]** Suggested jobs to run (before merge)

run-slow: auto, ernie4_5_vl_moe, glm46v, glm4v, glm4v_moe, qwen2_5_vl, qwen2_vl, qwen3_omni_moe