Metraipolis › archive › dc_2fa5240f138f
Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale — arXiv:2609.34292
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.34292
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T22:40:29.611Z
- SHA-256 of the archived text
e911a168ddcde0279bcc1ac9b7a5cf9548cbef190fe157699c59079090578eeb- Stable URL of this page
https://metraipolis.com/documento/dc_2fa5240f138f
How to cite
Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale — arXiv:2609.34292 — arXiv (en), https://arxiv.org/abs/2609.34292 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2fa5240f138f (Metraipolis archive dc_2fa5240f138f, sha256 e911a168ddcde0279bcc1ac9b7a5cf9548cbef190fe157699c59079090578eeb)
BibTeX
@misc{dc2fa5240f138f,
title = {Pre-registered tests of solid-state-physics-inspired LLM compression: a cluster-level negative result at small-language-model scale — arXiv:2609.34292},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.34292},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2fa5240f138f; sha256 e911a168ddcde0279bcc1ac9b7a5cf9548cbef190fe157699c59079090578eeb},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.34292. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
We report a three-month autonomous research-agent program testing five solid-state-physics-inspired compression mappings on pretrained language models, with predictions committed to git before any pilot data and a 3-sigma gate deciding PASS or SHELVE. The common anchor -- area-law / Kohn-nearsighted decay of the one-particle density matrix -- has a distance face (P001 Wannier, P002 tight-binding) and a rank face (P003 DMRG-truncated MLPs, P005 Wilson-RG, P011 tensor-train embeddings). P005 was pre-empted at Phase 1; three of four Phase-3 pilots were falsified. On the attention face, GPT-2-medium attention-versus-distance is best fit by a stretched exponential in 12 of 16 median-layer heads once probe padding is excluded, and a tight-binding cutoff costs +96% perplexity (P002); on Pythia-160M the Wannier sparsity 0.054 +/- 0.004 is indistinguishable from PCA, random-Haar and identity baselines (P001). On the rank face, per-token tensor-train bond dimension does not track surprisal (r = 0.016 vs a pre-registered 0.65) and the format inflates rather than compresses (P011). P003 is mixed: its scaling claim shelved (r = -0.434), its MPO premise died at stage-0, and its cross-paper check, r = 0.523 as first written, collapses to 0.047 under the same correction, leaving both cross-paper checks null. The results invert the pre-registered prediction that most attention heads behave like Kohn-nearsighted insulators, pointing instead to critical, glassy or heavy-tailed regimes; the inversion is specific to the <= 350M scale tested, while the rank-face no-gain result held to 7-8B. We contribute the pre-registration + 3-sigma + cluster-framing + append-only-catalogue discipline -- including why our own enforcement gate was designed but not deployed -- four pre-registered negative results with full data release, and the inversion. The catalogue holds eighteen concluded studies, seventeen negative. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-29 in cs.LG). Categorie arXiv: Disordered Systems and Neural Networks (cond-mat.dis-nn) ; Materials Science (cond-mat.mtrl-sci); Other Condensed Matter (cond-mat.other); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2609.34292 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T22:14:28.829Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-29?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).