Metraipolis › archive › dc_3dfed6145de5

Do Astronomical Foundation Models Know When They Will Fail? — arXiv:2610.02613

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.02613
License (as archived)
CC0-1.0
Archived
2026-10-06T10:46:40.044Z
SHA-256 of the archived text
2448ceadf96a2f49767139f31d30e5a8b37d4a7f22b2fc7355d1634eedad5182
Stable URL of this page
https://metraipolis.com/documento/dc_3dfed6145de5

How to cite

Do Astronomical Foundation Models Know When They Will Fail? — arXiv:2610.02613 — arXiv (en), https://arxiv.org/abs/2610.02613 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3dfed6145de5 (Metraipolis archive dc_3dfed6145de5, sha256 2448ceadf96a2f49767139f31d30e5a8b37d4a7f22b2fc7355d1634eedad5182)
BibTeX
@misc{dc3dfed6145de5,
  title = {Do Astronomical Foundation Models Know When They Will Fail? — arXiv:2610.02613},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.02613},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3dfed6145de5; sha256 2448ceadf96a2f49767139f31d30e5a8b37d4a7f22b2fc7355d1634eedad5182},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.02613. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Astronomical foundation models are increasingly used as reusable representations across surveys, but it is unclear when the same object remains consistently represented across instruments or whether a model can warn us before transfer fails. We present a conformal framework for auditing cross-survey representations using cross-matched Legacy Survey--HSC, HSC--JWST, and SDSS--HSC objects. Astronomy-specific AstroPT embeddings show lower translation errors and tighter conformal regions than general-purpose visual backbones at comparable coverage, while different model families fail on different objects. We then use adaptive conformal prediction to test whether the source embedding contains information about its own future error. Using a ridge difficulty model fitted to source embeddings, we find that this warning signal is consistent across the tested backbones for Legacy$\rightarrow$HSC, backbone-dependent for HSC$\rightarrow$JWST, and largely absent for SDSS$\rightarrow$HSC. When informative, adaptation improves coverage for the hardest objects. Matched-control analysis further reveals silent failures not explained by magnitude, apparent size, or nearest-neighbor distance. Hence, we show that conformal uncertainty provides a realistic way to identify when astronomical representations transfer reliably and when they fail without warning.

Tema degli esploratori: fisica e astronomia (retro-catalogo arXiv: annunci del 2026-10-05 in astro-ph.IM).
Categorie arXiv: Instrumentation and Methods for Astrophysics (astro-ph.IM).
Pagina del lavoro: https://arxiv.org/abs/2610.02613 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T09:47:48.522Z dalla pagina https://arxiv.org/catchup/astro-ph.IM/2026-10-05?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).