Metraipolis › archive › dc_cc0bf2286d0f

Zero-Complement Extrapolation: Parameter Recovery and Classification in Severely Imbalanced Logistic Regression under Rank-Deficient Regimes — arXiv:2610.39194

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.39194
License (as archived)
CC0-1.0
Archived
2026-11-01T02:27:06.800Z
SHA-256 of the archived text
1e8d8bb2af317ff7b18d54c801bedee9d9ea37efd8261c736c7a779b569c939e
Stable URL of this page
https://metraipolis.com/documento/dc_cc0bf2286d0f

How to cite

Zero-Complement Extrapolation: Parameter Recovery and Classification in Severely Imbalanced Logistic Regression under Rank-Deficient Regimes — arXiv:2610.39194 — arXiv (en), https://arxiv.org/abs/2610.39194 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_cc0bf2286d0f (Metraipolis archive dc_cc0bf2286d0f, sha256 1e8d8bb2af317ff7b18d54c801bedee9d9ea37efd8261c736c7a779b569c939e)
BibTeX
@misc{dccc0bf2286d0f,
  title = {Zero-Complement Extrapolation: Parameter Recovery and Classification in Severely Imbalanced Logistic Regression under Rank-Deficient Regimes — arXiv:2610.39194},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.39194},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_cc0bf2286d0f; sha256 1e8d8bb2af317ff7b18d54c801bedee9d9ea37efd8261c736c7a779b569c939e},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.39194. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Parameter estimation and classification in binary logistic regression deteriorate severely when the number of minority class observations ($n_1$) is smaller than the feature dimension ($p$). Under such rank-deficient rarity ($n_1 < p$), maximum likelihood estimators suffer from quasi-complete separation, penalized likelihood methods exhibit severe intercept bias, and convex minority oversampling techniques such as SMOTE collapse into an $(n_1 - 1)$-dimensional affine subspace. In this paper, we propose a novel \textit{Self-Calibrated Zero-Complement} estimator that shifts the paradigm from minority interpolation to majority fringe extrapolation. Grounded in Stein's Lemma, we prove that the conditional expectation shift of the abundant majority class ($Y=0$) induced by logistic truncation uniquely identifies the true hyperplane normal $\boldsymbol{\beta}$ after Mahalanobis whitening. We further establish that extrapolating synthetic minority instances outward from the high-quantile density fringe of the majority distribution along the conjugate direction preserves full-rank covariance regularity ($\mathrm{rank} = p$). To accommodate both semi-supervised environments (with an unlabeled background mean) and strictly supervised subsamples, we introduce a hybrid estimator incorporating the intrinsic third-moment skewness of the majority class alongside a location-shift-invariant zero-boundary intercept calibration. Extensive Monte Carlo simulations and real-world benchmark applications (Wisconsin Diagnostic Breast Cancer and Banknote Authentication) under extreme rarity ($n_1 \in \{3, 5\}$) demonstrate that our approach prevents parameter divergence, recovers the oracle hyperplane with high fidelity, and substantially outperforms Firth's regression and SMOTE in F1-score and estimation stability.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (stat.ML) ; Machine Learning (cs.LG); Methodology (stat.ME).
Pagina del lavoro: https://arxiv.org/abs/2610.39194 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-01T02:12:44.288Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).