Metraipolis › archive › dc_c8fb4667fe68

Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference — arXiv:2608.26354

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.26354
License (as archived)
CC0-1.0
Archived
2026-10-17T16:15:43.078Z
SHA-256 of the archived text
060978b0f173d4c18f6f8be87dfd9043d070a1c1c650dfd3914a9579eed3eb61
Stable URL of this page
https://metraipolis.com/documento/dc_c8fb4667fe68

How to cite

Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference — arXiv:2608.26354 — arXiv (en), https://arxiv.org/abs/2608.26354 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c8fb4667fe68 (Metraipolis archive dc_c8fb4667fe68, sha256 060978b0f173d4c18f6f8be87dfd9043d070a1c1c650dfd3914a9579eed3eb61)
BibTeX
@misc{dcc8fb4667fe68,
  title = {Cross-simulator transfer with foundation model summaries: Towards robust SKA-era reionization inference — arXiv:2608.26354},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.26354},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c8fb4667fe68; sha256 060978b0f173d4c18f6f8be87dfd9043d070a1c1c650dfd3914a9579eed3eb61},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.26354. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Simulation-based inference (SBI) for parameter estimation is vulnerable to model misspecification: neural summaries and density estimators trained on a specific forward model typically fail when applied to data drawn from another model, or from real observations, and no training simulator can capture the full observational pipeline of a real measurement exactly. We show that a self-supervised Vision Transformer (ViT), pretrained label-free on a fast approximate simulator, produces transferable data summaries that generalize across simulators. Without retraining, it can be reused as a frozen encoder to infer astrophysical parameters from a completely different simulator that resolves the radiative transfer explicitly, on which it has never seen either data or parameters. As a concrete use case in 21cm cosmology, SKATR, a ViT pretrained with a Joint Embedding Predictive Architecture (JEPA), serves as a foundation model for reionization inference from upcoming SKA measurements: SKATR is pretrained once on 67k low-cost, noiseless semi-numerical 21cmFAST lightcones, then frozen and applied to hydrodynamical Loreli II lightcones, where a lightweight conditional flow matching head infers five astrophysical parameters; the encoder is never shown Loreli data, its parameters, or any noise. In our comparison, SKATR yields the most precise and best-calibrated posteriors across all five parameters, matching the accuracy of the fully-supervised in-domain baseline while requiring 2.6x fewer radiative-transfer simulations. Under realistic SKA AA* noise, only SKATR remains simultaneously accurate, informative, and calibrated, outperforming even a supervised baseline retrained from scratch on noisy data. Self-supervised pretraining on computationally efficient semi-numerical simulations is therefore a viable route to calibrated, simulator- and noise-agnostic reionization inference for the SKA-era.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.LG).
Categorie arXiv: Cosmology and Nongalactic Astrophysics (astro-ph.CO) ; Instrumentation and Methods for Astrophysics (astro-ph.IM); Machine Learning (cs.LG); Data Analysis, Statistics and Probability (physics.data-an).
Pagina del lavoro: https://arxiv.org/abs/2608.26354 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T15:34:49.981Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).