Repository: EvolvingLMMs-Lab/lmms-eval
Issue: Qwen2_5_vl Eval Error when dealing with image reso less than 28
Root cause: Validation Gap

Eval Qwen2_5_vl on multimodal benchmark and it reported error when applying Qwen2_5_VLProcessor for image with reso less than 28. And the whole eval crashed.
Log's here
```
Traceback (most recent call last):                                                                                                      
  File "/usr/local/lib/python3.10/dist-packages/vllm/inputs/registry.py", line 168, in call_hf_processor                                
    return hf_processor(**data, **merged_kwargs, return_tensors="pt")                                                                   
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen2_5_vl/processing_qwen2_5_vl.py", line 123, in __call__         
    image_inputs = self.image_processor(images=images, videos=None, **output_kwargs["images_kwargs"])                                   
  File "/usr/local/lib/python3.10/dist-packages/transformers/image_processing_utils.py", line 42, in __call__                           
    return self.preprocess(images, **kwargs)                                                                                            
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen2_vl/image_processing_qwen2_vl.py", line 375, in preprocess     
    patches, image_grid_thw = self._preprocess(                                                                                         
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen2_vl/image_processing_qwen2_vl.py", line 226, in _preprocess    
    resized_height, resized_width = smart_resize(                                                                                       
  File "/usr/local/lib/python3.10/dist-packages/transformers/models/qwen2_vl/image_processing_qwen2_vl.py", line 69, in smart_resize    
    raise ValueError(f"height:{height} or width:{width} must be larger than factor:{factor}")                                           
ValueError: height:18 or width:187 must be larger than factor:28

Traceback (most recent call last):                                                                                                      
  File "/usr/lib/python3.10/runpy.py", line 196, in _run_module_as_main                                                                 
    return _run_code(code, main_globals, None,                                                                                          
  File "/usr/lib/python3.10/runpy.py", line 86, in _run_code                                                                            
    exec(code, run_globals)                                                                                                             
  ......
  File "/usr/local/lib/python3.10/dist-packages/vllm/model_executor/models/qwen2_vl.py", line 1013, in _call_hf_processor
    return self.info.ctx.call_hf_processor(
  File "/usr/local/lib/python3.10/dist-packages/vllm/inputs/registry.py", line 173, in call_hf_processor
    raise RuntimeError(msg) from exc
RuntimeError: Failed to apply Qwen2_5_VLProcessor on data={'text': '
', 'images': [<PIL.Image.Image image mode=RGB size=187x18 at 0x7F3BC552F0A0>]} with kwargs={}
```

May I ask how you solved this problem? I evaluated multiple datasets and found this issue, but I couldn't determine which dataset caused it.

Hi May I ask how you solved this problem too? I got this issue from time to time and have no idea what's going on.

Thank you!

Best Regards.

I proposed a PR #737 to address this issue