Metraipolis › archive › dc_2544ef59ca0d

Mutual Information Estimation via Triangular Transport Maps: Finite Sample Guarantees and Sample Allocation — arXiv:2611.00471

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.00471
License (as archived)
CC0-1.0
Archived
2026-11-03T18:42:31.727Z
SHA-256 of the archived text
1d26e89cd8c19533e7d41a994dc717873ecc7a964e2137696cf425c4c205bb8c
Stable URL of this page
https://metraipolis.com/documento/dc_2544ef59ca0d

How to cite

Mutual Information Estimation via Triangular Transport Maps: Finite Sample Guarantees and Sample Allocation — arXiv:2611.00471 — arXiv (en), https://arxiv.org/abs/2611.00471 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2544ef59ca0d (Metraipolis archive dc_2544ef59ca0d, sha256 1d26e89cd8c19533e7d41a994dc717873ecc7a964e2137696cf425c4c205bb8c)
BibTeX
@misc{dc2544ef59ca0d,
  title = {Mutual Information Estimation via Triangular Transport Maps: Finite Sample Guarantees and Sample Allocation — arXiv:2611.00471},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.00471},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2544ef59ca0d; sha256 1d26e89cd8c19533e7d41a994dc717873ecc7a964e2137696cf425c4c205bb8c},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.00471. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We study finite sample guarantees for transport based mutual information estimation. Mutual information can be estimated by first learning the conditional and marginal densities and then evaluating their log-density ratio by Monte Carlo. Given training samples, we use triangular transport maps to learn these densities and then compute the mutual information estimate on an independent batch of evaluation samples. For conditional density estimation using triangular transport maps, we establish non-asymptotic guarantees over realizable Hölder classes by viewing the conditional density as an ordinary density with respect to the product of the law of the conditioning variable and Lebesgue measure. This allows standard density estimation techniques to be applied directly to the conditional density estimation. These results yield finite sample guarantees for the resulting mutual information estimator and characterize how a fixed sample budget should be allocated between training and evaluation in order to minimize the mean squared error. Numerical experiments support the predicted training and evaluation error rates and illustrate the resulting sample allocation tradeoff.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv stat.ML, nuovi lavori del giorno).
Categorie arXiv: Statistics Theory (math.ST) ; Machine Learning (stat.ML).
Pagina del lavoro: https://arxiv.org/abs/2611.00471 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T18:13:37.678Z dalla pagina https://arxiv.org/list/stat.ML/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).