Metraipolis › archive › dc_d5b09ebd695c

DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation — arXiv:2609.00646

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.00646
License (as archived)
CC0-1.0
Archived
2026-10-17T06:31:59.805Z
SHA-256 of the archived text
c0de46f6c04d99894c5fded9e7a50990243d6d5166f2780f56b8b74c5c59d1b2
Stable URL of this page
https://metraipolis.com/documento/dc_d5b09ebd695c

How to cite

DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation — arXiv:2609.00646 — arXiv (en), https://arxiv.org/abs/2609.00646 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d5b09ebd695c (Metraipolis archive dc_d5b09ebd695c, sha256 c0de46f6c04d99894c5fded9e7a50990243d6d5166f2780f56b8b74c5c59d1b2)
BibTeX
@misc{dcd5b09ebd695c,
  title = {DramaChain Bench: An End-to-End Benchmark for Short-Drama Generation — arXiv:2609.00646},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.00646},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d5b09ebd695c; sha256 c0de46f6c04d99894c5fded9e7a50990243d6d5166f2780f56b8b74c5c59d1b2},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.00646. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Commercial short-drama production follows a multi-stage chain: script, storyboard, keyframe imagery, shot-level video, and the finished short drama. Most existing benchmarks evaluate solely the video-generation stage using pre-authored inputs instead of real upstream pipeline outputs. This leaves two critical questions unanswerable: whether each stage adheres to the original script intent (rather than only its immediate input prompt), and whether disparate shots remain coherent after assembly into multi-episode releases. We present DramaChain Bench, the first short-drama benchmark that evaluates every stage of the complete production chain. It is built upon three in-house systems sharing one dimension system, DramaChain Dimensions: five evaluation axes instantiated at every stage, resolving into 63 leaf dimensions. DramaChain Agent is calibrated against commercial short-drama platforms in both workflow and finished short-drama quality, enabling stage-wise fair comparison across models. DramaChain Labeling System has each of the 5,785 items scored independently by three professional annotators, with all defects spatio-temporally localised and selected from a predefined defect list. This process produces 17,488 valid scores and 255,925 traceable attribution records. The human annotations confirm that upstream defects cascade across the pipeline, demonstrating that final episode quality is not governed by video generation alone. DramaChain Agentic Judge then scores every leaf dimension automatically, gathering evidence over multiple agentic rounds before judging against a per-item checklist; it reproduces the model ranking at a mean PLCC of 0.918, enough to admit new models at no annotation cost.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-02 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.00646 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T06:15:12.625Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).