Metraipolis › archive › dc_272a41efb24e

Generalist Open-World Temporal Perception — arXiv:2609.06823

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.06823
License (as archived)
CC0-1.0
Archived
2026-10-16T15:09:27.685Z
SHA-256 of the archived text
f3c68b6190e0dfb06bdedc1b8aaace67184e8c533b0898378eec57bc992b573e
Stable URL of this page
https://metraipolis.com/documento/dc_272a41efb24e

How to cite

Generalist Open-World Temporal Perception — arXiv:2609.06823 — arXiv (en), https://arxiv.org/abs/2609.06823 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_272a41efb24e (Metraipolis archive dc_272a41efb24e, sha256 f3c68b6190e0dfb06bdedc1b8aaace67184e8c533b0898378eec57bc992b573e)
BibTeX
@misc{dc272a41efb24e,
  title = {Generalist Open-World Temporal Perception — arXiv:2609.06823},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.06823},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_272a41efb24e; sha256 f3c68b6190e0dfb06bdedc1b8aaace67184e8c533b0898378eec57bc992b573e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.06823. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

The next generation of artificial intelligence systems will likely be natively temporal and multimodal in both inputs and outputs: able to converse, perceive, predict, reason, and synthesize through a shared world representation. Realizing this requires a temporal perceptual substrate integrating sensory streams, language, and structured outputs within a multimodal world model. We seek a generalist open-world perceptual system that represents biological forms, natural physical structures, and artifacts, and their interactions, as a coherent, temporally persistent process. The model should infer geometry, articulation, semantics, interaction structure, and uncertainty from raw multimodal streams; maintain identity through occlusion and viewpoint change; generalize across species, forms, mechanisms, and materials; and abstain or expand its ontology when encountering the unknown. The objective is a structured world state supporting understanding, prediction, counterfactual reasoning, and controllable synthesis. Recent work suggests that some cross-modal and reasoning-like capabilities can emerge from large-scale generative video pretraining, reminiscent of language-model scaling. Yet these capabilities are often accessed through language probes or expressed through photorealistic video, leaving explicit semantic, geometric, or temporal structure largely unexposed. This paper articulates an alternative and complementary paradigm: perception and synthesis as distinct conditionings within a shared Generalist Open-World Temporal Perception Architecture (GOWTPA). Recognition, structured prediction, and simulation arise as different conditionings of the same generative substrate, while reasoning and embodiment-specific policies build upon the resulting world state. This positions generalist temporal perception as a potential foundation layer for broader multimodal intelligence and physical AI.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.06823 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T14:49:57.134Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).