Metraipolis › archive › dc_2ddca04df8c3

Joint Estimation and Feature Selection in Overspecified Finite Mixture of Regressions — arXiv:2610.22851

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.22851
License (as archived)
CC0-1.0
Archived
2026-10-19T09:37:37.160Z
SHA-256 of the archived text
9dcae6a5532bf4e7a379e7aff16fdee902e41c0a1917eda4370143b760edee56
Stable URL of this page
https://metraipolis.com/documento/dc_2ddca04df8c3

How to cite

Joint Estimation and Feature Selection in Overspecified Finite Mixture of Regressions — arXiv:2610.22851 — arXiv (en), https://arxiv.org/abs/2610.22851 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2ddca04df8c3 (Metraipolis archive dc_2ddca04df8c3, sha256 9dcae6a5532bf4e7a379e7aff16fdee902e41c0a1917eda4370143b760edee56)
BibTeX
@misc{dc2ddca04df8c3,
  title = {Joint Estimation and Feature Selection in Overspecified Finite Mixture of Regressions — arXiv:2610.22851},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.22851},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2ddca04df8c3; sha256 9dcae6a5532bf4e7a379e7aff16fdee902e41c0a1917eda4370143b760edee56},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.22851. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We investigate joint estimation and feature selection in sparse finite mixtures of regressions with an overspecified number of mixture components or mixture order. More specifically, given a conservative fixed upper bound on the unknown mixture order, we deliberately overspecify the order and propose a double-penalized likelihood approach for simultaneous parameter estimation and feature selection. We establish consistent recovery of the sparsity structure of the underlying mixing measure in terms of its regression coefficients, showing that the true sparsity of the mixture regression can be consistently identified even under order over-specification. The proposed methodology incorporates two complementary penalties: the first penalizes small (near-zero) mixing proportions, inducing an asymptotic Voronoi-type partition of the estimated regression vectors into clusters associated with the true sparse regression vectors; the second penalizes regression coefficients, resulting in sparsity through the selection of relevant features. Although the sparsity penalty is applied to individual regression coefficients, the combined effect of the two penalties yields an asymptotic group feature selection property where the same features tend to be selected or not selected within each Voronoi cluster. We develop a modified EM algorithm combined with proximal gradient for numerical implementations. Extensive simulations and a real data application demonstrate the effectiveness of the proposed approach.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv stat.ME, nuovi lavori del giorno).
Categorie arXiv: Methodology (stat.ME).
Pagina del lavoro: https://arxiv.org/abs/2610.22851 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-19T09:32:59.732Z dalla pagina https://arxiv.org/list/stat.ME/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).