Metraipolis › archive › dc_a34c0101546f
Localizing predictive concepts encoded in neural representations via hierarchical testing — arXiv:2610.41046
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2610.41046
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-02T07:49:24.910Z
- SHA-256 of the archived text
b329a80abc092b36b66b6f137bdad6cd434730faffca46d3a4675a68ca0fc566- Stable URL of this page
https://metraipolis.com/documento/dc_a34c0101546f
How to cite
Localizing predictive concepts encoded in neural representations via hierarchical testing — arXiv:2610.41046 — arXiv (en), https://arxiv.org/abs/2610.41046 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_a34c0101546f (Metraipolis archive dc_a34c0101546f, sha256 b329a80abc092b36b66b6f137bdad6cd434730faffca46d3a4675a68ca0fc566)
BibTeX
@misc{dca34c0101546f,
title = {Localizing predictive concepts encoded in neural representations via hierarchical testing — arXiv:2610.41046},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2610.41046},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_a34c0101546f; sha256 b329a80abc092b36b66b6f137bdad6cd434730faffca46d3a4675a68ca0fc566},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.41046. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Understanding which regulatory sequence motifs a genomic deep learning model has learned, with statistical error guarantees, is essential for trusting its use in downstream tasks such as variant effect prediction. Existing approaches to identifying which units in a trained network encode human- understandable concepts fall into two groups. Exploratory methods rank and visualize units but offer no statistical guarantee that the selected units are associated with the prediction target across the population of inputs. Testing-based methods test only single units or one pre-defined set of them, and do not control the error across the many sets of units. We introduce CUTTIE (Cluster-tree Unit Top-down Testing of Independence with Error control), which clusters the units of each layer into a tree and tests the clusters top-down with conditional independence tests, localizing information about the target while controlling the family-wise error rate. Thereby, we identify clusters that carry information about the target beyond the rest of the layer. For the units in the identified clusters, conditional attribution maps then reveal what motifs they encode. In a controlled simulation, the procedure identifies the clusters whose concepts affect the target. We apply the procedure to a convolutional model predicting cell-type-specific chromatin accessibility from DNA sequence, where the concepts encoded in the identified clusters map onto known regulatory motifs. Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno). Categorie arXiv: Machine Learning (cs.LG) ; Genomics (q-bio.GN). Pagina del lavoro: https://arxiv.org/abs/2610.41046 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-02T07:40:00.171Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).