Metraipolis › archive › dc_03e45be8221a
MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface — arXiv:2610.11316
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.11316
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-09T05:57:36.306Z
- SHA-256 of the archived text
90d06c172065b5f7c9d2d66f4867b0bb997990c47c6e0ef37b43758899c0c034- Stable URL of this page
https://metraipolis.com/documento/dc_03e45be8221a
How to cite
MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface — arXiv:2610.11316 — arXiv (en), https://arxiv.org/abs/2610.11316 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_03e45be8221a (Metraipolis archive dc_03e45be8221a, sha256 90d06c172065b5f7c9d2d66f4867b0bb997990c47c6e0ef37b43758899c0c034)
BibTeX
@misc{dc03e45be8221a,
title = {MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface — arXiv:2610.11316},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.11316},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_03e45be8221a; sha256 90d06c172065b5f7c9d2d66f4867b0bb997990c47c6e0ef37b43758899c0c034},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.11316. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
System One models output constrained decisions and probability distributions rather than free-form text generation. While prevailing paradigms rely on structured schema objects to encode state, intent, and candidate choices, we revisit a fully natural language-based System One interface. In this framework, both the user request and each candidate option are expressed in natural language, supported by multimodal (image and video) auxiliary inputs. We introduce MetaEncoder, which fine-tunes a pre-trained Muse-Glimmer 30B decoder into an instruction-following decision-making encoder. To scale effectively across both small closed-set (< 256) and massive open-set (millions) candidate spaces, MetaEncoder employs a bi-encoder architecture trained via unidirectional contrastive learning for request-candidate alignment. We conduct extensive evaluations across 11 benchmark suites and 190 tasks spanning multimodal decision-making, understanding (closed-set) and retrieval (open-set), highlighting where MetaEncoder beats SOTA multimodal encoders, as well as its current limits on reasoning-intensive tasks. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2610.11316 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-09T05:47:01.610Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).