Metraipolis › archive › dc_f2b308722bbd
Covariate-dependent Nonparametric $g$-modeling for regression via infinite Mixture-of-Expertizing class — arXiv:2610.08321
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.08321
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T11:46:30.588Z
- SHA-256 of the archived text
14509d7271d5a99a1f30afa842ce5f2c28d28ac09ece57f796c67a5d77738c7b- Stable URL of this page
https://metraipolis.com/documento/dc_f2b308722bbd
How to cite
Covariate-dependent Nonparametric $g$-modeling for regression via infinite Mixture-of-Expertizing class — arXiv:2610.08321 — arXiv (en), https://arxiv.org/abs/2610.08321 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_f2b308722bbd (Metraipolis archive dc_f2b308722bbd, sha256 14509d7271d5a99a1f30afa842ce5f2c28d28ac09ece57f796c67a5d77738c7b)
BibTeX
@misc{dcf2b308722bbd,
title = {Covariate-dependent Nonparametric $g$-modeling for regression via infinite Mixture-of-Expertizing class — arXiv:2610.08321},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.08321},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_f2b308722bbd; sha256 14509d7271d5a99a1f30afa842ce5f2c28d28ac09ece57f796c67a5d77738c7b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.08321. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Empirical Bayes $g$-modeling captures unit-level heterogeneity by estimating a latent prior distribution from observed data. In the existing formulations, however, the prior is shared by all units. In this paper, we develop a covariate-dependent g-modeling framework for regression in which the entire prior distribution of the regression coefficients is allowed to depend on covariates. We formulate the estimation of the prior as nonparametric maximum likelihood estimation (NPMLE) of the covariate-dependent prior, and show that the unrestricted problem is ill-posed. To resolve this, we introduce the infinite Mixture-of-Expertizing class of conditional priors, under which the NPMLE is precisely a softmax-gated Mixture of Experts (MoE) whose number of experts is not fixed in advance but is determined by the data. Building on a first-order optimality condition, we propose two exemplar-based estimation algorithms that select experts automatically, together with a post-hoc aggregation of experts for interpretation. On the theoretical side, we show that every conditional prior in the class is Lipschitz continuous in the covariates, and that aggregated softmax gates can approximate any continuous gate function. The effectiveness of the proposed NPMLE is shown through application to synthetic datasets and real datasets. Tema degli esploratori: statistica e scienza dei dati (elenco arXiv stat.ME, nuovi lavori del giorno). Categorie arXiv: Methodology (stat.ME). Pagina del lavoro: https://arxiv.org/abs/2610.08321 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T11:20:24.691Z dalla pagina https://arxiv.org/list/stat.ME/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).