Metraipolis › archive › dc_c3a77ca794d3

Between Hi-Fi and MMI: the overlap of redundancy and synergy in partial information decomposition — arXiv:2611.08131

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.08131
License (as archived)
CC0-1.0
Archived
2026-11-06T14:51:51.587Z
SHA-256 of the archived text
c01801ffb5eda92750dadbbb364b272d87e39cdbbd3c990b3c647c4c001a24f3
Stable URL of this page
https://metraipolis.com/documento/dc_c3a77ca794d3

How to cite

Between Hi-Fi and MMI: the overlap of redundancy and synergy in partial information decomposition — arXiv:2611.08131 — arXiv (en), https://arxiv.org/abs/2611.08131 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c3a77ca794d3 (Metraipolis archive dc_c3a77ca794d3, sha256 c01801ffb5eda92750dadbbb364b272d87e39cdbbd3c990b3c647c4c001a24f3)
BibTeX
@misc{dcc3a77ca794d3,
  title = {Between Hi-Fi and MMI: the overlap of redundancy and synergy in partial information decomposition — arXiv:2611.08131},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.08131},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c3a77ca794d3; sha256 c01801ffb5eda92750dadbbb364b272d87e39cdbbd3c990b3c647c4c001a24f3},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.08131. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Partial information decomposition (PID) splits the information that two sources carry about a target into redundant, unique and synergistic parts, with nonnegative decompositions lying on a segment where redundancy measures are bounded by the positive part of the co-information and the smaller source-target information. We parameterize this segment by the overlap, the common excess of redundancy and synergy over their net balance, and show that for many of the named PID measures, their redundancy can be written as the largest positive part of the co-information over a set of reference distributions. This common form induces an ordering of those PIDs on the segment. With the smallest redundancy and synergy and the largest unique atoms of any nonnegative PID, the information-theoretic version of Hi-Fi, a feature-importance method, is the zero-overlap end of the segment for two sources, with the maximum overlap bound given by the minimum mutual information (MMI) PID. We introduce, by splitting the co-information into a pairwise maximum- entropy part and the third-order connected information, a PID that sits at zero overlap except when pairwise redundancy and triadic synergy coexist. For three or more sources the bivariate results hold on every pair of merged source groups, and among all nonnegative solutions of the lattice equations MMI and Hi-Fi still give the smallest and largest unique atoms but zero overlap on all pairs at once is often unattainable. Two inequalities across pairs are necessary in general and sufficient for three sources. For identity targets zero overlap is possible exactly when the sources' information diagram is nonnegative. In random three- and four-source distributions zero overlap on all pairs fails in 21-100% of the cases.

Tema degli esploratori: statistica e scienza dei dati (elenco arXiv stat.ME, nuovi lavori del giorno).
Categorie arXiv: Information Theory (cs.IT) ; Data Analysis, Statistics and Probability (physics.data-an); Methodology (stat.ME).
Pagina del lavoro: https://arxiv.org/abs/2611.08131 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-06T14:22:42.534Z dalla pagina https://arxiv.org/list/stat.ME/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).