Metraipolis › archive › dc_2532b8409a8a
Cleaning or Recalling? Knowledge Dependence in LLM-based Data Cleaning [Experiment, Analysis & Benchmark] — arXiv:2611.08106
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2611.08106
- License (as archived)
- CC0-1.0
- Archived
- 2026-11-06T14:54:16.119Z
- SHA-256 of the archived text
ebaa6d8df522f2c27bbfc31c21421051a52acb9c0b7aca8c905bd30dc41e8604- Stable URL of this page
https://metraipolis.com/documento/dc_2532b8409a8a
How to cite
Cleaning or Recalling? Knowledge Dependence in LLM-based Data Cleaning [Experiment, Analysis & Benchmark] — arXiv:2611.08106 — arXiv (en), https://arxiv.org/abs/2611.08106 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2532b8409a8a (Metraipolis archive dc_2532b8409a8a, sha256 ebaa6d8df522f2c27bbfc31c21421051a52acb9c0b7aca8c905bd30dc41e8604)
BibTeX
@misc{dc2532b8409a8a,
title = {Cleaning or Recalling? Knowledge Dependence in LLM-based Data Cleaning [Experiment, Analysis & Benchmark] — arXiv:2611.08106},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2611.08106},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2532b8409a8a; sha256 ebaa6d8df522f2c27bbfc31c21421051a52acb9c0b7aca8c905bd30dc41e8604},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2611.08106. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
High scores on public data-cleaning benchmarks can reflect knowledge of familiar entities, making it difficult to assess how well an LLM repairs unfamiliar data. We present CoRE (Cleaning or Recalling), a protocol comparing public benchmarks with fresh real records and paired name surrogates built from English words or syllables. The surrogates retain error positions and non-identity values while transferring the benchmark's error mechanisms. Across 21 controlled tables and eight LLMs, repair performance varies substantially with entity names on Hospital and, for commercial models, Movies. Renaming removes some information needed for repair, such as a film's identifier mapping. It also affects repairs whose candidates remain available: replacing entity names with word-based surrogates lowers DeepSeek-V4-Pro's year accuracy from 91% to 18%. On Hospital and Movies, commercial models score higher on fresh records than on word-based surrogates. A screened continuation probe finds no positive evidence of benchmark-row memory in the tested models. Familiar facts can conflict with the task. Even with explicit table-evidence instructions, commercial models rewrite assigned directors at rates of 0.000-0.404 on known films. Reference scoring can also disagree with external records. On Rayyan, an ISSN correction matching a title-matched PubMed record receives no credit, whereas 94% of TabClean's credited repairs reproduce the reference date transformation. We provide controlled tables, scoring code and materials for offline replay. Tema degli esploratori: statistica e scienza dei dati (elenco arXiv cs.DB, nuovi lavori del giorno). Categorie arXiv: Databases (cs.DB). Pagina del lavoro: https://arxiv.org/abs/2611.08106 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-11-06T14:26:12.515Z dalla pagina https://arxiv.org/list/cs.DB/new (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).