Metraipolis › archive › dc_2c93a8b4e39a

A Human-Verified AI Workflow for Annotating Environmental Sound Data — arXiv:2611.03271

Source
arXiv (en)
Original
https://arxiv.org/abs/2611.03271
License (as archived)
CC0-1.0
Archived
2026-11-03T11:23:10.720Z
SHA-256 of the archived text
56f74418d0a744720b3299f77a8625bd64a5a9761a32687c89a416e3498a89d4
Stable URL of this page
https://metraipolis.com/documento/dc_2c93a8b4e39a

How to cite

A Human-Verified AI Workflow for Annotating Environmental Sound Data — arXiv:2611.03271 — arXiv (en), https://arxiv.org/abs/2611.03271 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2c93a8b4e39a (Metraipolis archive dc_2c93a8b4e39a, sha256 56f74418d0a744720b3299f77a8625bd64a5a9761a32687c89a416e3498a89d4)
BibTeX
@misc{dc2c93a8b4e39a,
  title = {A Human-Verified AI Workflow for Annotating Environmental Sound Data — arXiv:2611.03271},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2611.03271},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2c93a8b4e39a; sha256 56f74418d0a744720b3299f77a8625bd64a5a9761a32687c89a416e3498a89d4},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.03271. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large-scale annotation of environmental sound recordings presents significant challenges under time and resource constraints, particularly when sound categories are imbalanced and only part of a dataset has been labeled. This paper describes the development and evaluation of a human-AI workflow used during annotation of the Kenya Forest Sounds Dataset (KFSD), using a project-stage working collection of 7,531 audio recordings across 21 categories. We investigated zero-shot classification, a feature-based ensemble, and a fine-tuned Audio Spectrogram Transformer (AST). The fine-tuned AST achieved 89.36% accuracy, 85.98% precision, 89.24% recall, and 87.58% F1 on held-out test data for binary classification of Person talking. Because this result remained below the predefined 95% threshold for autonomous annotation, model predictions were used as suggestions and subjected to human verification. Of the 5,026 initially unlabeled recordings, 2,337 were routed to a speech-verification queue and 2,689 remained for ordinary manual annotation. The verifier reviewed all 2,337 machine-labeled files and detected zero false positives, yielding 100% verification accuracy. The observed average verification time was approximately 4.2 seconds per file. At an average rate of 35 seconds per file for manual annotation, the hybrid workflow reduced work on the remaining queue from approximately 48.9 to 28.9 person-hours, saving about 20.0 hours (41%). The study documents the model-selection process, provenance-aware file organization, verification procedure, observed errors, practical limitations, and opportunities for extending AI assistance beyond one category.

Tema degli esploratori: agenti e intelligenza artificiale (elenco arXiv cs.LG, nuovi lavori del giorno).
Categorie arXiv: Machine Learning (cs.LG) ; Sound (cs.SD).
Pagina del lavoro: https://arxiv.org/abs/2611.03271 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-11-03T11:02:37.689Z dalla pagina https://arxiv.org/list/cs.LG/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).