Metraipolis › archive › dc_c4058cb1bbaf
"Will This Data Break My Task?" - Interactive Synthesis of Task-Aware Data Unit Tests — arXiv:2608.09376
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.09376
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-19T09:14:24.832Z
- SHA-256 of the archived text
979ff4dcc1d3d181795bbe004e08bb3fd55b9fb9cc71dd4bd03abb07f1d259c0- Stable URL of this page
https://metraipolis.com/documento/dc_c4058cb1bbaf
How to cite
"Will This Data Break My Task?" - Interactive Synthesis of Task-Aware Data Unit Tests — arXiv:2608.09376 — arXiv (en), https://arxiv.org/abs/2608.09376 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_c4058cb1bbaf (Metraipolis archive dc_c4058cb1bbaf, sha256 979ff4dcc1d3d181795bbe004e08bb3fd55b9fb9cc71dd4bd03abb07f1d259c0)
BibTeX
@misc{dcc4058cb1bbaf,
title = {"Will This Data Break My Task?" - Interactive Synthesis of Task-Aware Data Unit Tests — arXiv:2608.09376},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.09376},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_c4058cb1bbaf; sha256 979ff4dcc1d3d181795bbe004e08bb3fd55b9fb9cc71dd4bd03abb07f1d259c0},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.09376. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Data is a central resource for modern enterprises and institutions, and data errors propagating through data pipelines lead to serious impact in production. Therefore, data validation is essential for ensuring the reliability of downstream applications. This led to the development of data unit tests, executable programs that test data before moving it around through large data pipelines. However, existing frameworks derive data unit tests from observed data alone, ignoring the semantics of the code that consumes the data downstream. To this end, we present PrismaDV, a compound AI system that synthesizes task-aware data unit tests for tabular data by jointly analyzing data and downstream task code. PrismaDV decomposes the test generation into multiple LLM-powered steps: data profiling, detection of column accesses, data flow analysis in the task code, and the inference of implicit data assumptions. It subsequently synthesizes code for the data unit test, and maintains an internal ``data-code assumption graph'' that links generated data constraints back to the task's source code. We demonstrate PrismaDV through an interactive web-based interface where attendees run the system on five real-world datasets with 60 downstream tasks, synthesize, inspect and refine both natural language assumptions about the data and executable data constraints. The interface allows attendees to navigate the data-code assumption graph, compare task-aware data unit tests against task-agnostic baselines on erroneous data batches, and interactively edit assumptions and data constraints. Furthermore, attendees can observe how a custom prompt optimizer adapts the system to specific datasets over time. Tema degli esploratori: statistica e scienza dei dati (retro-catalogo arXiv: annunci del 2026-08-11 in cs.DB). Categorie arXiv: Databases (cs.DB). Pagina del lavoro: https://arxiv.org/abs/2608.09376 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-19T09:12:27.039Z dalla pagina https://arxiv.org/catchup/cs.DB/2026-08-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).