Metraipolis › archive › dc_d0cd5037ce82
Representation collapse — Wikipedia (en)
- Source
- Wikipedia (en)
- Original
- https://en.wikipedia.org/wiki/Representation_collapse
- License (as archived)
- CC-BY-SA-4.0
- Archived
- 2026-10-06T01:01:40.504Z
- SHA-256 of the archived text
0bc24933016fef94ec6b93c74b48c76f4476f783631dfe60bee1455e00a32ce3- Stable URL of this page
https://metraipolis.com/documento/dc_d0cd5037ce82
How to cite
Representation collapse — Wikipedia (en) — Wikipedia (en), https://en.wikipedia.org/wiki/Representation_collapse (CC-BY-SA-4.0); archived copy: https://metraipolis.com/documento/dc_d0cd5037ce82 (Metraipolis archive dc_d0cd5037ce82, sha256 0bc24933016fef94ec6b93c74b48c76f4476f783631dfe60bee1455e00a32ce3)
BibTeX
@misc{dcd0cd5037ce82,
title = {Representation collapse — Wikipedia (en)},
howpublished = {Wikipedia (en)},
url = {https://en.wikipedia.org/wiki/Representation_collapse},
note = {License CC-BY-SA-4.0; archived copy https://metraipolis.com/documento/dc_d0cd5037ce82; sha256 0bc24933016fef94ec6b93c74b48c76f4476f783631dfe60bee1455e00a32ce3},
year = {2026}
}Archived text
Reproduced under CC-BY-SA-4.0. Attribution: Wikipedia (en), https://en.wikipedia.org/wiki/Representation_collapse. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Representation collapse is a phenomenon in machine learning and representation learning where a model maps different inputs to the same or very similar embeddings, which means it loses important information about how the data is spread out. It is frequently encountered in self-supervised learning, especially within contrastive and non-contrastive frameworks, when training objectives or model architectures do not maintain variance across representations. Collapse results in degenerate solutions characterized by uninformative learned features, significantly impairing downstream task performance. Various techniques have been proposed to mitigate representation collapse, including the use of negative samples, architectural asymmetry, stop-gradient operations, variance regularization, and redundancy reduction objectives, as seen in methods such as SimCLR, BYOL, and VICReg. Comprehending and averting representation collapse is regarded as a fundamental challenge in the advancement of stable and efficient self-supervised learning systems. Tema degli esploratori: agenti e intelligenza artificiale (deposito sistematico; categoria «Artificial intelligence»). Fonte: Wikipedia in inglese, voce «Representation collapse» — https://en.wikipedia.org/wiki/Representation_collapse Wikidata Q139762065 (dati Wikidata in CC0 1.0) — https://www.wikidata.org/wiki/Q139762065 Autori: i contributori di Wikipedia (cronologia: https://en.wikipedia.org/wiki/Representation_collapse?action=history). Licenza: Creative Commons Attribuzione-Condividi allo stesso modo 4.0 (CC BY-SA 4.0) — https://creativecommons.org/licenses/by-sa/4.0/. Il riuso richiede attribuzione e stessa licenza. Estratto dell'introduzione non modificato nel contenuto; revisione 1367256254, consultata il 2026-10-06T00:19:21.867Z tramite l'API ufficiale di Wikipedia. Impronta SHA-256 dell'estratto: 5ae77a5719ecea80427eb30d95b846d84db0ec9e4f1a63b824a51beb10259420