Metraipolis › archive › dc_e07267bb2c11

Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning — arXiv:2608.14290

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.14290
License (as archived)
CC0-1.0
Archived
2026-10-19T02:20:47.581Z
SHA-256 of the archived text
2ab9a4930c938184e4f9a7d6826906a8f3ba47d59006c3605e7622a3551dbfb7
Stable URL of this page
https://metraipolis.com/documento/dc_e07267bb2c11

How to cite

Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning — arXiv:2608.14290 — arXiv (en), https://arxiv.org/abs/2608.14290 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e07267bb2c11 (Metraipolis archive dc_e07267bb2c11, sha256 2ab9a4930c938184e4f9a7d6826906a8f3ba47d59006c3605e7622a3551dbfb7)
BibTeX
@misc{dce07267bb2c11,
  title = {Intern-S2-Mobius: Foundation Model with Decoupled Knowledge and Reasoning — arXiv:2608.14290},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.14290},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e07267bb2c11; sha256 2ab9a4930c938184e4f9a7d6826906a8f3ba47d59006c3605e7622a3551dbfb7},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.14290. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We introduce Mobius-v0, an architecture that comprises a globally shared Memory (FFN) that stores knowledge vectors and multiple Reasoners (Self-Attn) that iteratively achieve compositional reasoning. Using hidden states as cache and carrier, reasoners repeatedly query memory for required knowledge-vectors, while the knowledge is transmitted back to reasoning operators. Through this knowledge-reasoning-separation architecture, Mobius achieves better knowledge compression and reasoning efficiency. Built upon Mobius-v0 architecture: 1) Our 7B model trained-from-scratch achieves similar downstream score as a 7B Transformer baseline with 62.6% of baseline's training data. 2) Our Intern-S2-Mobius, continually-pretrained from Qwen3.5-35B, achieves similar downstream score while delivering nearly 4x end-to-end inference speedup.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-17 in cs.AI).
Categorie arXiv: Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2608.14290 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T02:02:02.803Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-17?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).