Metraipolis › archive › dc_e7afdae4c04f

Who Called? V33DA: A Physically Verified Multimodal Benchmark for Vocal Attribution in Zebra Finch Groups — arXiv:2610.38109

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.38109
License (as archived)
CC0-1.0
Archived
2026-11-01T02:26:54.390Z
SHA-256 of the archived text
fba7f724ada90bf698e9944d7dd5963313fc8971ed081a1ae55bafd691f91e9b
Stable URL of this page
https://metraipolis.com/documento/dc_e7afdae4c04f

How to cite

Who Called? V33DA: A Physically Verified Multimodal Benchmark for Vocal Attribution in Zebra Finch Groups — arXiv:2610.38109 — arXiv (en), https://arxiv.org/abs/2610.38109 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_e7afdae4c04f (Metraipolis archive dc_e7afdae4c04f, sha256 fba7f724ada90bf698e9944d7dd5963313fc8971ed081a1ae55bafd691f91e9b)
BibTeX
@misc{dce7afdae4c04f,
  title = {Who Called? V33DA: A Physically Verified Multimodal Benchmark for Vocal Attribution in Zebra Finch Groups — arXiv:2610.38109},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.38109},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_e7afdae4c04f; sha256 fba7f724ada90bf698e9944d7dd5963313fc8971ed081a1ae55bafd691f91e9b},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.38109. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Deciding which member of an animal group produced a vocalization and where that vocalization was produced are central to studying social communication but are rarely evaluated with physically verified ground truth. Existing resources either localize sounds without identifying the caller, or recognize individuals from isolated vocalizations without reliance on the 3D candidate geometry. We close this gap with V33DA, a dataset-centered multimodal benchmark for spatial vocal attribution in social zebra finches: it comprises 33,625 verified events coupling 5-channel audio with three camera views, calibrated 3D pose for every visible candidate, and per-bird radio telemetry across 10 individuals and three experiments. Caller identity is verified from an on-body accelerometer-derived vibration signal; this channel is withheld from benchmark models and used only by an on-body reference ceiling. Given a detected vocalization and the visible candidate birds, the task is to select the caller. We evaluate it under three regimes: session-disjoint testing on familiar birds from held-out recording dates, held-out-experiment transfer to a new cohort, and leave-one-individual-out evaluation on a bird whose vocalizations are held out from training. Reference methods expose a consistent gap between in-domain accuracy and transfer to unseen individuals: methods that can exploit familiar vocal identity perform well on known callers but degrade sharply on unseen ones, whereas candidate-aware methods preserving explicit spatial reasoning transfer substantially better. The on-body reference stays near-perfect across regimes, confirming the internal consistency of the accelerometer-verified labels. We release V33DA with fixed protocols and code for the evaluated methods, and V33DA++, an unevaluated companion set of verified overlapping-call events and +/-2 s context windows.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Sound (cs.SD) ; Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM).
Pagina del lavoro: https://arxiv.org/abs/2610.38109 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-01T02:12:44.246Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).