Hugging Face's logo

stepfun-ai
/
Step1X-Edit

Image-to-Image
Transformers
English
multimodal
Eval Results
Model card Files
xet
 Community
10

Add VDEBench evaluation results

#10
by SaylorTwift HF Staff - opened
base: refs/heads/main
←
from: refs/pr/10
Discussion Files changed
+22
-0
SaylorTwift
 Hugging Face CLI

Hi πŸ‘‹ this PR adds this model's VDEBench scores to .eval_results/, so they show up on the model page and on the VDEBench leaderboard.

VDEBench evaluates instruction-guided editing of dense English/Chinese document pages (3,506 examples). Each score is the equally weighted mean of IoU, CDM, BLEU-4 and TEDS (0–1, higher is better):

Task Score
local (edited region, headline) 0.482
global (full page) 0.580

Scores come from the VDEBench paper (arXiv:2602.00122v4, Table 2), and the VDEBench authors confirmed both the values and the evaluated checkpoint (discussion).

While this PR is open the scores appear as community-provided; merging it makes them official, and closing it removes them. Docs: https://huggingface.co/docs/hub/eval-results Β· https://huggingface.co/docs/hub/leaderboard-data-guide

Thanks!
Add VDEBench evaluation results878676b9
Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment