Metraipolis › archive › dc_2fa7743ec074

VidUEU-Agent: A Data-Curation Agent for Multimodal Understanding, Editing, and Unified Tasks — arXiv:2611.04418

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.04418
License (as archived)
CC0-1.0
Archived
2026-11-04T12:56:24.397Z
SHA-256 of the archived text
b5b61fcefcd87d4494d6ce6982ead7cec98e557d6ea8e6bb363f9e22b4897b64
Stable URL of this page
https://metraipolis.com/documento/dc_2fa7743ec074

How to cite

VidUEU-Agent: A Data-Curation Agent for Multimodal Understanding, Editing, and Unified Tasks — arXiv:2611.04418 — arXiv (en), https://arxiv.org/abs/2611.04418 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2fa7743ec074 (Metraipolis archive dc_2fa7743ec074, sha256 b5b61fcefcd87d4494d6ce6982ead7cec98e557d6ea8e6bb363f9e22b4897b64)
BibTeX
@misc{dc2fa7743ec074,
  title = {VidUEU-Agent: A Data-Curation Agent for Multimodal Understanding, Editing, and Unified Tasks — arXiv:2611.04418},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.04418},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2fa7743ec074; sha256 b5b61fcefcd87d4494d6ce6982ead7cec98e557d6ea8e6bb363f9e22b4897b64},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.04418. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

The advancement of multimodal learning is heavily constrained by the scarcity and high annotation cost of high-quality instruction data. While raw videos offer an abundant and dynamic source of visual knowledge, transforming them into precise instruction data remains highly challenging. To bridge this gap, we present VidUEU-Agent, an automated pipeline that synthesizes instruction data from raw videos for multimodal understanding, editing, and unified tasks. VidUEU-Agent follows a four-stage pipeline: it performs global perception to filter low-quality shots, mines keyframes and multimodal signals, constructs metadata and routes the metadata to synthesize instruction samples. More importantly, our agent framework can autonomously iterate the data distribution based on downstream training results, thereby optimizing data quality, balance, and training effectiveness. Scaling this pipeline, we construct VidUEU-100K, a large-scale dataset of 100K training samples spanning multiple domains and tasks, providing a robust foundation for developing comprehensive multimodal capabilities. Extensive experiments demonstrate that fine-tuning baseline models on VidUEU-100K yields significant and consistent performance gains across diverse representative benchmarks, validating the effectiveness of our proposed agent framework and dataset.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.CV, nuovi lavori del giorno).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV).
Pagina del lavoro: https://arxiv.org/abs/2611.04418 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-04T12:33:47.144Z dalla pagina https://arxiv.org/list/cs.CV/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).