Metraipolis › archive › dc_33ab26fa5fcd

Marginal Fidelity Does Not Establish User Simulation in Demographic Synthetic Survey Panels: Response Contracts, Support Collapse and Conditioning Failure — arXiv:2609.07305

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.07305
License (as archived)
CC0-1.0
Archived
2026-10-16T12:45:32.254Z
SHA-256 of the archived text
80ca16f7f0be3ee3b213ab75c3c000e7eb9d644fd2bcb385450d282ad49bf9ef
Stable URL of this page
https://metraipolis.com/documento/dc_33ab26fa5fcd

How to cite

Marginal Fidelity Does Not Establish User Simulation in Demographic Synthetic Survey Panels: Response Contracts, Support Collapse and Conditioning Failure — arXiv:2609.07305 — arXiv (en), https://arxiv.org/abs/2609.07305 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_33ab26fa5fcd (Metraipolis archive dc_33ab26fa5fcd, sha256 80ca16f7f0be3ee3b213ab75c3c000e7eb9d644fd2bcb385450d282ad49bf9ef)
BibTeX
@misc{dc33ab26fa5fcd,
  title = {Marginal Fidelity Does Not Establish User Simulation in Demographic Synthetic Survey Panels: Response Contracts, Support Collapse and Conditioning Failure — arXiv:2609.07305},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.07305},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_33ab26fa5fcd; sha256 80ca16f7f0be3ee3b213ab75c3c000e7eb9d644fd2bcb385450d282ad49bf9ef},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.07305. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Demographic synthetic survey panels are often validated by matching aggregate answers to published surveys. We test what that certificate establishes across six multiselect batteries from four survey organisations in three countries. The headline analysis is restricted to three instruments whose synthetic cohort and human target share the stated population frame; three other batteries remain sensitivity analyses. The response contract dominates measured fidelity. In the aligned instruments, committed sets leave 66 of 128 model-battery option slots empty in panels of up to 500 respondents, versus 0 of 128 under per-option probability elicitation. Across eight uncapped model-instrument comparisons, probabilities reduce option-marginal MAE by 4.53 to 7.30 points. The capped instrument reverses on two models until the vectors are projected onto its stated maximum. These are measurement effects: human targets are realised check-all responses, whereas the vectors are latent inclusion propensities. Published marginal agreement also fails to discriminate respondent simulation from direct population estimation. On nine aligned model-battery pairs, a no-persona population-prevalence query averages 6.27 MAE versus 12.39 for committed panels and wins all nine comparisons. Constraint-aware probability vectors average 5.34 and beat the query on four of nine, so the baseline challenges the validation criterion rather than proving direct estimation uniformly best. On three unpublished demographic cells, neither approach beats reciting the national distribution. Population-marginal agreement is therefore evidence about an elicitation contract and an estimand obtainable without simulated respondents, not evidence of individual simulation.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-09 in cs.CL).
Categorie arXiv: Computation and Language (cs.CL) ; Human-Computer Interaction (cs.HC).
Pagina del lavoro: https://arxiv.org/abs/2609.07305 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T12:30:25.107Z dalla pagina https://arxiv.org/catchup/cs.CL/2026-09-09?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).