Metraipolis › archive › dc_7eef3f338f56
Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding — arXiv:2609.36217
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.36217
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-07T18:38:04.078Z
- SHA-256 of the archived text
b1200d7d9660403b86e4efc2de91a692589df901f837545d6bd8e606a30332ae- Stable URL of this page
https://metraipolis.com/documento/dc_7eef3f338f56
How to cite
Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding — arXiv:2609.36217 — arXiv (en), https://arxiv.org/abs/2609.36217 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_7eef3f338f56 (Metraipolis archive dc_7eef3f338f56, sha256 b1200d7d9660403b86e4efc2de91a692589df901f837545d6bd8e606a30332ae)
BibTeX
@misc{dc7eef3f338f56,
title = {Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding — arXiv:2609.36217},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.36217},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_7eef3f338f56; sha256 b1200d7d9660403b86e4efc2de91a692589df901f837545d6bd8e606a30332ae},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.36217. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
A deeper understanding of brain function requires a precise, structured characterization of behavior. Yet, extracting behavioral representations from video in a form suitable for scientific analysis remains a fundamental challenge. Many prior studies represent behavior via pose estimation or nonlinear video embeddings. However, pose tracking discards rich information beyond predefined keypoints, while nonlinear video embeddings lack interpretability. We address this limitation with SABLE (Sparse-view Animal Behavior Latent Embeddings), a self-supervised framework that leverages a geometric inductive bias to learn behavior representations. By augmenting a multi-view transformer with priors from monocular depth and pose estimation, SABLE reconstructs 3D animal behavior from extremely sparse views while learning explicit 3D latent structure. Without ground-truth 3D labels, it reliably recovers 3D behavior from two-view videos, whereas state-of-the-art (SOTA) methods fail or yield degenerate solutions. Across the International Brain Lab and Cheese3D datasets, we demonstrate that SABLE learns 3D representations that match or exceed prior SOTA performance in neural encoding and decoding. Once pretrained across animals, SABLE serves as an off-the-shelf model that generalizes zero-shot to unseen animals without animal-specific calibration or retraining. Our method establishes 3D-aware video embeddings that capture complex behavior, opening new avenues for studying brain-behavior relationships. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-09-30 in cs.CV). Categorie arXiv: Computer Vision and Pattern Recognition (cs.CV). Pagina del lavoro: https://arxiv.org/abs/2609.36217 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-07T18:04:24.684Z dalla pagina https://arxiv.org/catchup/cs.CV/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).