Metraipolis › archive › dc_9a32dc1daec0

The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussions — arXiv:2511.08592

Source
arXiv (en)
Original
https://arxiv.org/abs/2511.08592
License (as archived)
CC0-1.0
Archived
2026-10-07T16:24:33.607Z
SHA-256 of the archived text
78ba1b4f9a95bea9161bffdd517451bff84a5e25de67abd7fdea5ff959a5cf62
Stable URL of this page
https://metraipolis.com/documento/dc_9a32dc1daec0

How to cite

The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussions — arXiv:2511.08592 — arXiv (en), https://arxiv.org/abs/2511.08592 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_9a32dc1daec0 (Metraipolis archive dc_9a32dc1daec0, sha256 78ba1b4f9a95bea9161bffdd517451bff84a5e25de67abd7fdea5ff959a5cf62)
BibTeX
@misc{dc9a32dc1daec0,
  title = {The Collective Turing Test: Large Language Models Can Generate Realistic Multi-User Discussions — arXiv:2511.08592},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2511.08592},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_9a32dc1daec0; sha256 78ba1b4f9a95bea9161bffdd517451bff84a5e25de67abd7fdea5ff959a5cf62},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2511.08592. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large Language Models (LLMs) offer new avenues to simulate online communities and social media. Potential applications range from testing the design of content recommendation algorithms to estimating the effects of content policies and interventions. However, the validity of using LLMs to simulate conversations between various users remains largely untested. We evaluated whether LLMs can convincingly mimic human group conversations on social media. We collected authentic human conversations from Reddit and generated artificial conversations on the same topic with two LLMs: Llama 3 70B and GPT-4o. When presented side-by-side to study participants, LLM-generated conversations were mistaken for human-created content 39\% of the time. In particular, when evaluating conversations generated by Llama 3, participants correctly identified them as AI-generated only 56\% of the time, barely better than random chance. Our study demonstrates that LLMs can generate social media conversations sufficiently realistic to deceive humans when reading them, highlighting both a promising potential for social simulation and a warning message about the potential misuse of LLMs to generate new inauthentic social media content.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-30 in cs.AI).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI); Social and Information Networks (cs.SI).
Pagina del lavoro: https://arxiv.org/abs/2511.08592 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-07T15:54:53.696Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-30?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).