Metraipolis › archive › dc_63a68da0160f

Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation — arXiv:2609.03557

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.03557
License (as archived)
CC0-1.0
Archived
2026-10-17T02:56:19.837Z
SHA-256 of the archived text
c8bdebeaee3d40b2d0b8570790abfb51391a78741a18eec655f29d1934a49078
Stable URL of this page
https://metraipolis.com/documento/dc_63a68da0160f

How to cite

Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation — arXiv:2609.03557 — arXiv (en), https://arxiv.org/abs/2609.03557 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_63a68da0160f (Metraipolis archive dc_63a68da0160f, sha256 c8bdebeaee3d40b2d0b8570790abfb51391a78741a18eec655f29d1934a49078)
BibTeX
@misc{dc63a68da0160f,
  title = {Building Pretraining Data for World Models: An Unreal Engine-Based Pipeline for Action-Conditioned Video Generation — arXiv:2609.03557},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.03557},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_63a68da0160f; sha256 c8bdebeaee3d40b2d0b8570790abfb51391a78741a18eec655f29d1934a49078},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.03557. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Action-conditioned video models require large-scale visual data paired with control signals that are temporally aligned with the resulting scene transitions. Such supervision is difficult to obtain from ordinary real-world video because the actions that caused each visual change are typically unknown. We present a large-scale synthetic data production pipeline built on Unreal Engine for generating action-conditioned, multi-view video. To accommodate the different execution requirements of real-time physics and high-quality offline rendering, the pipeline executes trajectory generation and final rendering in two stages: Stage I runs real physics in PIE and records per-frame character states, control inputs, and camera states into an intermediate trajectory representation; Stage II replays those trajectories in a new engine process and renders them offline with Movie Render Queue (MRQ). Around this core, we develop a distributed production system with cache-aware task partitioning, node-local slot scheduling, automated scene screening, aesthetic and luminance filtering, partial-output recovery, asynchronous upload, and continuous cluster health monitoring. The production cluster contains 25 servers with eight NVIDIA RTX 5090 GPUs per server. From 2,384 asset packs, 429 levels were retained for production together with a pool of 40 humanoid characters. The pipeline has produced 2,691 hours of 1080p video and 6,076 hours of 720p video. We describe the system architecture, the implementation decisions that emerged from production failures, and the limitations of using perceptual quality proxies for world-model data curation. The pipeline described in this report constitutes the Unreal Engine synthetic-data production component used in EchoWM.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-04 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Graphics (cs.GR).
Pagina del lavoro: https://arxiv.org/abs/2609.03557 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T02:27:18.969Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-04?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).