Metraipolis › archive › dc_e6eed18d45d4

CoaG: Cylinders on a Grid for Coarse 3D Layout Control in Video Generation — arXiv:2609.24208

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.24208
License (as archived)
CC0-1.0
Archived
2026-10-09T22:05:23.912Z
SHA-256 of the archived text
4ba69c71c57b8640572af639c046e9bf6d2d493a7025f6cc9c321380d3b66d8f
Stable URL of this page
https://metraipolis.com/documento/dc_e6eed18d45d4

How to cite

CoaG: Cylinders on a Grid for Coarse 3D Layout Control in Video Generation — arXiv:2609.24208 — arXiv (en), https://arxiv.org/abs/2609.24208 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e6eed18d45d4 (Metraipolis archive dc_e6eed18d45d4, sha256 4ba69c71c57b8640572af639c046e9bf6d2d493a7025f6cc9c321380d3b66d8f)
BibTeX
@misc{dce6eed18d45d4,
  title = {CoaG: Cylinders on a Grid for Coarse 3D Layout Control in Video Generation — arXiv:2609.24208},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.24208},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e6eed18d45d4; sha256 4ba69c71c57b8640572af639c046e9bf6d2d493a7025f6cc9c321380d3b66d8f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.24208. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We ask how little geometry a person has to draw to control both where people stand and where the camera moves in a generated video. Our answer is a ground plane and one cylinder per person. A user draws a grid on the ground, places one cylinder where each person should stand, moves the cylinders and the camera over 81 frames, and the model renders a photoreal video in which the people occupy the cylinders' positions, move as the cylinders move, and are seen from the drawn camera. Appearance comes from a text prompt and a background reference image; layout and motion come from the geometry. Because no dataset pairs such a signal with video, we build the pairs ourselves: an automatic engine writes 2000 captions from a combinatorial seed, generates a clip for each with a text-to-video model, and lifts every clip back to its geometry with person tracking, background inpainting, an agentic ground-mask loop, feed-forward multi-view reconstruction and a plane fit, with no real footage and no manual labels. A LoRA on Wan2.2-Fun-Control trained on 1935 such tuples follows drawn layouts and camera paths on hold-out clips: the generated people match the cylinders' count, order, position and height, the text changes who they are, the reference image changes where they are, and dolly-in, orbit, pan and crane paths are followed, dolly-out only weakly.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-22 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.24208 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T21:45:21.008Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-22?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).