Metraipolis › archive › dc_97de2e778791

Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews — arXiv:2609.31191

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.31191
License (as archived)
CC0-1.0
Archived
2026-10-08T01:39:47.555Z
SHA-256 of the archived text
13ca3da4449cc247e81f07a908fb2ab3360902e56dbbd2142816450acd1539ed
Stable URL of this page
https://metraipolis.com/documento/dc_97de2e778791

How to cite

Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews — arXiv:2609.31191 — arXiv (en), https://arxiv.org/abs/2609.31191 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_97de2e778791 (Metraipolis archive dc_97de2e778791, sha256 13ca3da4449cc247e81f07a908fb2ab3360902e56dbbd2142816450acd1539ed)
BibTeX
@misc{dc97de2e778791,
  title = {Rethinking Data Quality for AI-Driven Systems: Evidence from Practitioner Interviews — arXiv:2609.31191},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.31191},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_97de2e778791; sha256 13ca3da4449cc247e81f07a908fb2ab3360902e56dbbd2142816450acd1539ed},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.31191. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Data quality research has usually treated data as an input that is stored, processed, and validated. In AI-driven software-intensive systems, data also shapes model behavior, evaluation, and lawful use. Empirical evidence remains limited on how practitioners define, assess, and manage quality under these conditions. We interviewed 16 practitioners from nine organizations and analyzed the transcripts using reflexive thematic analysis and developed six themes from participants' accounts. In AI systems, traceability shifted from modular debugging to attributing model behavior, while using models as quality assessors introduced circularity. Agent context and memory became data objects, and synthetic and pseudo-labeled data made authenticity a quality concern. In foundation-model development, lawfulness became a gate for training data, while representativeness was judged through coverage of situations in which the system must behave safely. Prior ML research examines many of these problems separately. Our study provides a practitioner-grounded account of how they are encountered together as an engineering and organizational concern. We also interpret five recurring conditions as helping explain how the themes relate to reduced trust in data and AI outcomes. We synthesize these findings through lifecycle assurance: a conceptual framing focused on producing evidence that data can support a specific AI claim when its influence may be embedded in model behavior, model-based judgments, or agent actions.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-28 in cs.AI).
Categorie arXiv: Software Engineering (cs.SE) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.31191 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-08T01:12:14.554Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).