Metraipolis › archive › dc_d4c196bb43fa

Diagnosing the Demographic Distributions of LLM-Based Synthetic Persona Data: Reference-Distribution Dependence and Post Hoc Adjustment — arXiv:2608.28668

Source
arXiv (en)
Original
https://arxiv.org/abs/2608.28668
License (as archived)
CC0-1.0
Archived
2026-10-17T08:19:19.006Z
SHA-256 of the archived text
58e5f82f54531fca05fbf196fedd62f384dddcdc3248d5ed531ecdbc17f11745
Stable URL of this page
https://metraipolis.com/documento/dc_d4c196bb43fa

How to cite

Diagnosing the Demographic Distributions of LLM-Based Synthetic Persona Data: Reference-Distribution Dependence and Post Hoc Adjustment — arXiv:2608.28668 — arXiv (en), https://arxiv.org/abs/2608.28668 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_d4c196bb43fa (Metraipolis archive dc_d4c196bb43fa, sha256 58e5f82f54531fca05fbf196fedd62f384dddcdc3248d5ed531ecdbc17f11745)
BibTeX
@misc{dcd4c196bb43fa,
  title = {Diagnosing the Demographic Distributions of LLM-Based Synthetic Persona Data: Reference-Distribution Dependence and Post Hoc Adjustment — arXiv:2608.28668},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2608.28668},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_d4c196bb43fa; sha256 58e5f82f54531fca05fbf196fedd62f384dddcdc3248d5ed531ecdbc17f11745},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.28668. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

We examine how strongly demographic-distribution diagnostics of LLM-based synthetic persona data depend on the official statistics chosen as the reference. We compared the sex $\times$ age-group $\times$ province joint distribution of the 1,000,000 Nemotron-Personas-Korea (NPK) records with Korean official statistics using total variation distance (TVD). Against the resident-registration population for April 2026, the time of use, the upper bound on the share discrepancy of any subgroup defined by the three variables was 1.81 percentage points, the margin of error of a survey with about 2,900 respondents. This value, however, depended on the reference date and population definition of the official statistics. The closest candidate examined, the 2024 census distribution for Korean nationals, gave 0.56 percentage points; no monthly resident-registration reference was closer. The reference distributions themselves also moved: between January 2025, when NPK's distance was smallest, and April 2026, the resident-registration distribution moved by more than twice that minimum distance, as did the census Korean-national distribution between 2024 and 2025. Raking reduced the range of the distance across reference months to about one fifth. Cell poststratification was applicable because none of the 204 cells was empty, and neither scheme produced extreme weights. Demographic alignment is necessary but not sufficient for response validity, and even this basic diagnostic depends on the choice of reference distribution. Providers should therefore disclose the source, reference date, population definition, and joint-cell allocation procedure of the official statistics used for demographic attributes, and users should repeat the diagnosis and adjustment against statistics current at the time of use.

Tema degli esploratori: governance digitale e beni comuni (retro-catalogo arXiv: annunci del 2026-09-01 in cs.CY).
Categorie arXiv: Computers and Society (cs.CY) ; Applications (stat.AP).
Pagina del lavoro: https://arxiv.org/abs/2608.28668 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-17T08:07:56.342Z dalla pagina https://arxiv.org/catchup/cs.CY/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).