Metraipolis › archive › dc_3ccf1945ecd9

Learning Behaviorally Relevant Dynamics in Multimodal Neural Recordings — arXiv:2611.05167

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.05167
License (as archived)
CC0-1.0
Archived
2026-11-04T21:38:17.200Z
SHA-256 of the archived text
cd232911fa4cc0400363f6282ef52c7e2a1f10eaab130735dc9edcabded1be8f
Stable URL of this page
https://metraipolis.com/documento/dc_3ccf1945ecd9

How to cite

Learning Behaviorally Relevant Dynamics in Multimodal Neural Recordings — arXiv:2611.05167 — arXiv (en), https://arxiv.org/abs/2611.05167 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3ccf1945ecd9 (Metraipolis archive dc_3ccf1945ecd9, sha256 cd232911fa4cc0400363f6282ef52c7e2a1f10eaab130735dc9edcabded1be8f)
BibTeX
@misc{dc3ccf1945ecd9,
  title = {Learning Behaviorally Relevant Dynamics in Multimodal Neural Recordings — arXiv:2611.05167},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.05167},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3ccf1945ecd9; sha256 cd232911fa4cc0400363f6282ef52c7e2a1f10eaab130735dc9edcabded1be8f},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.05167. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Multimodal neural data can enable a more complete understanding of brain dynamics underlying behavior. Modalities such as spiking activity, local field potentials (LFPs), and behavior capture diverse spatiotemporal aspects of brain processes, yet prior neural-behavioral models that separate sources of variability rely on a single neural modality. By leveraging these complementary strengths, multimodal neural fusion can provide a unified, rich representation of brain-behavior processes and address the limitations of single-modality analyses. Here we develop BREM-NET, a nonlinear multimodal dynamical model that integrates behavior with multiple neural modalities having distinct statistical characteristics and temporal resolutions. BREM-NET performs multimodal neural fusion during inference while separating behaviorally relevant and residual neural dynamics via a structured learning framework. In a public multimodal non-human primate dataset with simultaneous spiking and local field potential recordings during a 2D reaching task, BREM-NET separates these two types of dynamics and learns them more accurately, as reflected in better behavior decoding, better neural prediction, and stronger latent alignment with behavior, and it retains these capabilities when neural modalities are asynchronous or suffer dropouts, which are major challenges in real-world recordings. This framework provides a new tool for studying behaviorally relevant neural computations across spatiotemporal scales of brain activity.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.AI, nuovi lavori del giorno).
Categorie arXiv: Artificial Intelligence (cs.AI) ; Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE).
Pagina del lavoro: https://arxiv.org/abs/2611.05167 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-04T21:35:49.588Z dalla pagina https://arxiv.org/list/cs.AI/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).