Metraipolis › archive › dc_19628ecca83f

UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation — arXiv:2610.09823

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.09823
License (as archived)
CC0-1.0
Archived
2026-10-08T11:11:29.720Z
SHA-256 of the archived text
b5e34a98a98366f2ecc9aeef6e5617e862df1ed0a1da1f8d8f0fc01c43bcea9d
Stable URL of this page
https://metraipolis.com/documento/dc_19628ecca83f

How to cite

UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation — arXiv:2610.09823 — arXiv (en), https://arxiv.org/abs/2610.09823 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_19628ecca83f (Metraipolis archive dc_19628ecca83f, sha256 b5e34a98a98366f2ecc9aeef6e5617e862df1ed0a1da1f8d8f0fc01c43bcea9d)
BibTeX
@misc{dc19628ecca83f,
  title = {UltraText Bench: A Comprehensive Bilingual Benchmark for Evaluating Visual Text Rendering in Image Generation — arXiv:2610.09823},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.09823},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_19628ecca83f; sha256 b5e34a98a98366f2ecc9aeef6e5617e862df1ed0a1da1f8d8f0fc01c43bcea9d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.09823. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Dense visual text requires image generators to reproduce long strings across multiple regions with correct placement and legibility. As short-string rendering improves, evaluation must test sustained performance across more demanding scenes. We introduce UltraText Bench, a bilingual benchmark for prompt-only generation of dense visual text. It contains 432 prompts spanning 24 real-world scene categories and three difficulty levels, split equally between English and Chinese. Each human-reviewed prompt supplies exact strings for four to twelve text regions, paired with structured references for their content, placement, and visual attributes. We use the Q-Judger vision-language model to assess each image against the complete reference, reporting text fidelity, text clarity, spatial quality, and scene quality. Across 24 model configurations, these dimensions reveal different strengths: Z-Image-Turbo gains 3.81 clarity points over Z-Image-Base while losing 14.76 fidelity points under the reported settings. Performance also varies with workload; Qwen-Image-2512's English composite falls from 86.50 at L1 to 42.86 at L3. Ten participants took part in human evaluation of the automatic scores. Repository: this https URL .

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.09823 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T10:14:06.128Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).