Metraipolis › archive › dc_ece72a540b9e
Measuring Brand and Source Discovery under Repeated LLM Queries: A Finite-Sample Audit — arXiv:2609.05059
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.05059
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-16T22:36:02.729Z
- SHA-256 of the archived text
aa1ab1f4435ff1583a48bf65aabba103e5dd46138d4d4ebe3af8edcb34735d7b- Stable URL of this page
https://metraipolis.com/documento/dc_ece72a540b9e
How to cite
Measuring Brand and Source Discovery under Repeated LLM Queries: A Finite-Sample Audit — arXiv:2609.05059 — arXiv (en), https://arxiv.org/abs/2609.05059 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ece72a540b9e (Metraipolis archive dc_ece72a540b9e, sha256 aa1ab1f4435ff1583a48bf65aabba103e5dd46138d4d4ebe3af8edcb34735d7b)
BibTeX
@misc{dcece72a540b9e,
title = {Measuring Brand and Source Discovery under Repeated LLM Queries: A Finite-Sample Audit — arXiv:2609.05059},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.05059},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ece72a540b9e; sha256 aa1ab1f4435ff1583a48bf65aabba103e5dd46138d4d4ebe3af8edcb34735d7b},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.05059. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Repeated-query audits must distinguish recovery of a collected set from completeness of possible outputs. We apply sample-based rarefaction to 4,500 responses from 50 buying questions, six configurations and 15 calls per cell. Historical-dictionary median ten-call recovery of the observed 15-call set ranges from 92.6% to 95.2%; re-adjudicating all 45,683 candidate strings changes this range to 89.5%-94.7%. Two blinded Gemini 3.1 Pro annotation roles assessed 600 complete answers, yielding micro F1 of 0.908 for canonical-name agreement and 0.975 for span-overlap agreement. This is AI-based evidence, without a human reference study. A separate matched roster analysis of 3,750 records per wave gives median single-call recovery of the observed five-call set of 80.0%-92.5% in February and 90.0%-100.0% in September, with question-subset dependence. Source accumulation also changes when API-returned hosts are restricted to those referenced by answer citation markers. These findings show that recovery percentages depend on extraction, question selection and the finite reference collection. They support explicit measurement definitions and sensitivity analyses, without establishing exhaustive repertoires, causal retrieval effects or a universal stopping rule. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-07 in cs.CL). Categorie arXiv: Information Retrieval (cs.IR) ; Computation and Language (cs.CL). Pagina del lavoro: https://arxiv.org/abs/2609.05059 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-16T22:21:16.324Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-07?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).