Metraipolis › archive › dc_e1441fe7d254
Thomson: Continual Learning of Frontier Models for SovereignAI — arXiv:2608.27147
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.27147
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T14:23:32.811Z
- SHA-256 of the archived text
9af32549a426df132c3f5a87e38d7152babeb1ad5a641bfdf2bfba282bddecc0- Stable URL of this page
https://metraipolis.com/documento/dc_e1441fe7d254
How to cite
Thomson: Continual Learning of Frontier Models for SovereignAI — arXiv:2608.27147 — arXiv (en), https://arxiv.org/abs/2608.27147 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e1441fe7d254 (Metraipolis archive dc_e1441fe7d254, sha256 9af32549a426df132c3f5a87e38d7152babeb1ad5a641bfdf2bfba282bddecc0)
BibTeX
@misc{dce1441fe7d254,
title = {Thomson: Continual Learning of Frontier Models for SovereignAI — arXiv:2608.27147},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.27147},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e1441fe7d254; sha256 9af32549a426df132c3f5a87e38d7152babeb1ad5a641bfdf2bfba282bddecc0},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.27147. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetry between developers and the diverse user base of modern AI. Recent public discourse acknowledges this concern, calling for SovereignAI (an organisation's capability to independently build, deploy and govern AI use), but offers little concrete advice on how this can be achieved in the short term under a diversity of funding settings. We argue that frontier performance is achievable by a wide range of institutions through Continual Learning on readily available open-weight models. Unlike limited approaches such as small-scale fine-tuning, prompt engineering, or tool-augmentation of a frozen model, our approach exploits a modern mid- & post-training stack while introducing safeguards that preserve both plasticity and stability at each stage, making the minimal number of high-impact interventions on the parameters. This yields gains comparable to those typically seen across multiple successive model generations, at compute and personnel budgets substantially lower than commonly thought, making ownership of large parts of the SovereignAI stack (model, tool infrastructure, values & data privacy) viable for far more actors. We demonstrate this with Thomson, a general-purpose frontier model trained with an enhanced focus on high-stakes professional work. Thomson performs competitively with recent frontier models across agentic tasks, safety, legal, tax & multilingualism, and large-scale Deep Research. Evaluations show a distinctive $\pi$-shaped pattern: distinct improvements across a wide range of capabilities, including those not explicitly targeted, while almost completely eliminating the forgetting problem common to narrow domain adaptation. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.27147 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T13:16:53.554Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).