Metraipolis › archive › dc_4e157215ad92

FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning — arXiv:2609.35728

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.35728
License (as archived)
CC0-1.0
Archived
2026-10-07T23:54:57.581Z
SHA-256 of the archived text
ff058da28a5c056cfa8ec4320a2163c9ad4016cf427d68d21a66a19208c223d3
Stable URL of this page
https://metraipolis.com/documento/dc_4e157215ad92

How to cite

FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning — arXiv:2609.35728 — arXiv (en), https://arxiv.org/abs/2609.35728 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_4e157215ad92 (Metraipolis archive dc_4e157215ad92, sha256 ff058da28a5c056cfa8ec4320a2163c9ad4016cf427d68d21a66a19208c223d3)
BibTeX
@misc{dc4e157215ad92,
  title = {FlowAct-R2: Beyond Talking Avatar via Streaming Multimodal References and Proactive Agent Planning — arXiv:2609.35728},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.35728},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_4e157215ad92; sha256 ff058da28a5c056cfa8ec4320a2163c9ad4016cf427d68d21a66a19208c223d3},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.35728. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We present FlowAct-R2, a framework for interactive humanoid video generation that combines continuous multimodal control with proactive agent planning. Our method consists of two coupled components. First, a Streaming Multimodal Reference Diffusion Transformer adapts the pretrained Seedance 2.0 Mini reference-to-video backbone to accept rolling action prompts, streaming audio, and dynamically updated image, audio, and video references. Video-driven rotary positional embeddings align reference chunks with the generation timeline, while reference-plus-image conditioning and partially noised historical motion frames preserve appearance and avoid accumulated drift. Second, a Proactive Interaction Agent separates pre-online planning from online scheduling and response: it prepares a persona, a long-horizon agenda, and reusable multimodal skills in advance, then autonomously schedules behaviors, responds to audience input, and handles interruptions during a live session. FlowAct-R2 supports real-time 720p generation and hour-scale streaming across entertainment streaming, live shopping, video chatting, and live vlogging.

Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-29 in cs.CV).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2609.35728 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T23:29:27.633Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).