Metraipolis › archive › dc_ddf4ae9bf7b6

The microscope is the mask: privileged views and labels from a cryo-ET forward model — arXiv:2609.04325

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.04325
License (as archived)
CC0-1.0
Archived
2026-10-16T22:59:46.252Z
SHA-256 of the archived text
5ff0ae72ae04c5963b18284569cb3455568d83778fd31038b62f6588db2b923b
Stable URL of this page
https://metraipolis.com/documento/dc_ddf4ae9bf7b6

How to cite

The microscope is the mask: privileged views and labels from a cryo-ET forward model — arXiv:2609.04325 — arXiv (en), https://arxiv.org/abs/2609.04325 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ddf4ae9bf7b6 (Metraipolis archive dc_ddf4ae9bf7b6, sha256 5ff0ae72ae04c5963b18284569cb3455568d83778fd31038b62f6588db2b923b)
BibTeX
@misc{dcddf4ae9bf7b6,
  title = {The microscope is the mask: privileged views and labels from a cryo-ET forward model — arXiv:2609.04325},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.04325},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ddf4ae9bf7b6; sha256 5ff0ae72ae04c5963b18284569cb3455568d83778fd31038b62f6588db2b923b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.04325. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We explore the use of simulated data for training a model for protein annotation in crowded cryo-electron tomography volumes reconstructed from images collected at limited tilt angles and severely corrupted by the measurement operator. Firstly, we leverage the corruptions imposed by the forward model to generate domain-specific augmented paired views of the exact same scene for an invariance objective integrated into the LeJEPA self-supervised training framework. Secondly, we use additional information from the simulation pipeline such as the positions and identity of proteins in the simulated volumes to inform the architecture of the model and the loss function, so that semantic information is localised at protein positions in the resulting dense feature volume. The resulting model, CARNIVAL, is evaluated without finetuning on classification and detection tasks in real tomograms, using a benchmark dataset containing multiple protein types and two tomogram processing types. We show that CARNIVAL outperforms a state-of-the-art model trained using a contrastive objective on simulated data but without forward model-based paired views or privileged information.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-07 in cs.LG).
Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV) ; Machine Learning (cs.LG); Optimization and Control (math.OC).
Pagina del lavoro: https://arxiv.org/abs/2609.04325 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T22:31:32.228Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).