Hugging Face's logo

FireRedTeam
/
FireRed-Image-Edit-1.0

Image-to-Image
Diffusers
Safetensors
English
Chinese
QwenImageEditPlusPipeline
Eval Results
Model card Files
xet
 Community
13

Add VDEBench evaluation results

#13
by SaylorTwift HF Staff - opened
base: refs/heads/main
←
from: refs/pr/13
Discussion Files changed
+22
-0
SaylorTwift
 Hugging Face CLI

Hi πŸ‘‹ this PR adds this model's VDEBench scores to .eval_results/, so they show up on the model page and on the VDEBench leaderboard.

VDEBench evaluates instruction-guided editing of dense English/Chinese document pages (3,506 examples). Each score is the equally weighted mean of IoU, CDM, BLEU-4 and TEDS (0–1, higher is better):

Task Score
local (edited region, headline) 0.690
global (full page) 0.748

Scores come from the VDEBench paper (arXiv:2602.00122v4, Table 2), and the VDEBench authors confirmed both the values and the evaluated checkpoint (discussion).

While this PR is open the scores appear as community-provided; merging it makes them official, and closing it removes them. Docs: https://huggingface.co/docs/hub/eval-results Β· https://huggingface.co/docs/hub/leaderboard-data-guide

Thanks!
Add VDEBench evaluation resultsc04beee8
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment