Metraipolis › archive › dc_f0cf71c3f97a

UniData: Universal Multimodal Instruction Generation Pipeline — arXiv:2610.11363

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.11363
License (as archived)
CC0-1.0
Archived
2026-10-09T05:47:41.006Z
SHA-256 of the archived text
faa34360de0dd3105935f419ef4eab85a88d0981adb4f3114808d56964d9f05c
Stable URL of this page
https://metraipolis.com/documento/dc_f0cf71c3f97a

How to cite

UniData: Universal Multimodal Instruction Generation Pipeline — arXiv:2610.11363 — arXiv (en), https://arxiv.org/abs/2610.11363 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f0cf71c3f97a (Metraipolis archive dc_f0cf71c3f97a, sha256 faa34360de0dd3105935f419ef4eab85a88d0981adb4f3114808d56964d9f05c)
BibTeX
@misc{dcf0cf71c3f97a,
  title = {UniData: Universal Multimodal Instruction Generation Pipeline — arXiv:2610.11363},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.11363},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f0cf71c3f97a; sha256 faa34360de0dd3105935f419ef4eab85a88d0981adb4f3114808d56964d9f05c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.11363. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Multimodal Large Language Models (MLLMs) are increasingly being applied in a wider range of real-world scenarios. However, due to the substantial labor cost, creating high-quality multimodal instruction datasets for MLLMs remains a significant challenge. Although some methods propose to generate instruction data, they often face limitations in modality support and struggle with generating multi-round instructions. To address these problems, we introduce UniData, a universal instruction generation pipeline, to transform simple user requirements into multi-round, multimodal instructions. Specifically, UniData first expands user requirements into multiple diverse events. Using these events, UniData then integrates an any-to-any large model for multimodal instruction generation. Finally, UniData enhances data quality by correcting irrelevant and redundant inference flow, leveraging correlations between instruction rounds. To train this pipeline, we also build UniDataset, a dataset comprising 20,000 entries across nine modalities for improved multimodal generation. Our experiments demonstrate that UniData achieves SOTA performance in data quality and can also enhance the understanding and generation capabilities of other multimodal models.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2610.11363 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-09T05:47:00.698Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).