Metraipolis › archive › dc_b4eae03c9595

Quieter Than the Room: Representation Drift and Task Robustness in Speech Encoders — arXiv:2609.27195

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.27195
License (as archived)
CC0-1.0
Archived
2026-10-08T10:05:36.174Z
SHA-256 of the archived text
690380850f5335ec43ccacab7ddf2d7ce13c5559f19d0edc9be1eb1b9fa6c959
Stable URL of this page
https://metraipolis.com/documento/dc_b4eae03c9595

How to cite

Quieter Than the Room: Representation Drift and Task Robustness in Speech Encoders — arXiv:2609.27195 — arXiv (en), https://arxiv.org/abs/2609.27195 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_b4eae03c9595 (Metraipolis archive dc_b4eae03c9595, sha256 690380850f5335ec43ccacab7ddf2d7ce13c5559f19d0edc9be1eb1b9fa6c959)
BibTeX
@misc{dcb4eae03c9595,
  title = {Quieter Than the Room: Representation Drift and Task Robustness in Speech Encoders — arXiv:2609.27195},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.27195},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_b4eae03c9595; sha256 690380850f5335ec43ccacab7ddf2d7ce13c5559f19d0edc9be1eb1b9fa6c959},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.27195. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Non-speech interference can change a speech representation without causing comparable task loss. We test eight frozen encoders on four tasks, adding non-speech sounds throughout recordings, during speech, or in pauses. Under whole-recording interference, embedding drift tracks task loss across seven sounds, with mean Spearman correlations of 0.81-0.88. Moving the same sound between speech and pauses changes this pattern. At quiet to moderate levels, pause interference produces larger drift, while speech interference usually causes greater loss on intent recognition, speaker verification and speech recognition. Emotion recognition shows a weaker placement effect. Pause interference also changes speech-frame representations beyond the injected region. Even below the estimated recording background, interference can change embeddings as much as repeated speech takes do. Drift helps rank the effects of different sounds, but larger drift does not consistently indicate greater task loss.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-24 in cs.CL).
Categorie arXiv: Sound (cs.SD) ; Computation and Language (cs.CL).
Pagina del lavoro: https://arxiv.org/abs/2609.27195 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T09:11:49.679Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-24?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).