Metraipolis › archive › dc_e013e55be689

Data-informed Adaptation of Foundation Models for Causal Effect Estimation — arXiv:2611.11504

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.11504
License (as archived)
CC0-1.0
Archived
2026-11-10T18:43:26.476Z
SHA-256 of the archived text
bdcfdb1b88c2ed84e26098bcfb88a7651a54b27264a366045eb81c9741bc130e
Stable URL of this page
https://metraipolis.com/documento/dc_e013e55be689

How to cite

Data-informed Adaptation of Foundation Models for Causal Effect Estimation — arXiv:2611.11504 — arXiv (en), https://arxiv.org/abs/2611.11504 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e013e55be689 (Metraipolis archive dc_e013e55be689, sha256 bdcfdb1b88c2ed84e26098bcfb88a7651a54b27264a366045eb81c9741bc130e)
BibTeX
@misc{dce013e55be689,
  title = {Data-informed Adaptation of Foundation Models for Causal Effect Estimation — arXiv:2611.11504},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.11504},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e013e55be689; sha256 bdcfdb1b88c2ed84e26098bcfb88a7651a54b27264a366045eb81c9741bc130e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.11504. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Due to the fundamental problem of causal inference -- the impossibility of observing counterfactual outcomes -- there is always a gap between the training goal (outcome, propensity) and the inference target (CATE, ATE). Traditional causal effect estimation revolves around setting assumptions, selecting identification strategies, and choosing causal estimators, while more recently, Causal Foundation Models (CFMs), built on Prior-Data-Fitted Networks (PFNs), ease this process by pretraining on massive synthetic prior datasets. Despite their success, such amortization makes causal inference less transparent, obscuring which assumptions the model implicitly relies on for a given dataset. The high diversity of real-world data-generating processes (DGPs) and Structural Causal Models (SCMs) makes it hard to know, a priori, which causal inference strategy is compatible with a given dataset. In this work, we focus on this compatibility between an observational dataset and method-specific assumptions, and find that geometric characteristics of data embeddings -- specifically, the variogram -- provide a useful signal of whether a given causal estimation strategy is appropriate. We develop MoE-Learner, a mixture-of-causal-experts framework that embeds a dataset under multiple assumption-specific views and uses the variogram as a counterfactual-free router to assess each expert's validity. Rather than eliminating causal assumptions, this shifts their validation from a fixed, a priori choice to a criterion that can be checked directly from data geometry. MoE-Learner achieves the best average rank on benchmark datasets (IHDP, ACIC, Lalonde). Being orthogonal to (causal) foundation models, our method builds a bridge from data characteristics to causal estimation strategy rather than proposing another CFM.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2611.11504 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-10T18:37:37.644Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).