Metraipolis › archive › dc_aa04ef7e4387
Authorship attribution and aesthetic evaluation of AI poetry: a case study with Haiku — arXiv:2609.15511
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2609.15511
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-15T22:53:51.670Z
- SHA-256 of the archived text
802115be6b0336ed1391c1ca79cb9e4a14d37dfd19ba6bad6d2713acf98de89d- Stable URL of this page
https://metraipolis.com/documento/dc_aa04ef7e4387
How to cite
Authorship attribution and aesthetic evaluation of AI poetry: a case study with Haiku — arXiv:2609.15511 — arXiv (en), https://arxiv.org/abs/2609.15511 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_aa04ef7e4387 (Metraipolis archive dc_aa04ef7e4387, sha256 802115be6b0336ed1391c1ca79cb9e4a14d37dfd19ba6bad6d2713acf98de89d)
BibTeX
@misc{dcaa04ef7e4387,
title = {Authorship attribution and aesthetic evaluation of AI poetry: a case study with Haiku — arXiv:2609.15511},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2609.15511},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_aa04ef7e4387; sha256 802115be6b0336ed1391c1ca79cb9e4a14d37dfd19ba6bad6d2713acf98de89d},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.15511. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
This paper investigates the generation and human evaluation of Japanese haiku by contemporary Large Language Models (LLMs), focusing on authorship perception and aesthetic judgment within a constrained poetic form. Using a few-shot prompting strategy, Japanese haiku were generated across a heterogeneous set of large language models, including open- and closed-source systems, medium-scale and large-scale architectures, models with native or adapted Japanese support, and multilingual proprietary models. These AI-generated haiku were combined with human-written ones and presented in a questionnaire distributed to students at Japanese universities in Tokyo. The survey assessed whether respondents could distinguish between AI-generated and human-written haiku and which cues informed their judgments. Recognition accuracy varied across models. GPT-5, Gemini 2.5, and StableLM-7B performed at approximately chance level (approx 0.50), whereas LLM-JP, Gemma-2B, and LLaMA-2 showed moderate detectability (approx 0.59-0.67). However, recognition was strongly item-dependent. Ratings of fluency, coherence, poeticness, and related aesthetic dimensions predicted perceived humanness but not correct classification, indicating an attribution bias linked to aesthetic evaluation and revealing a dissociation between aesthetic evaluation and true authorship detection. The extended analysis additionally examines generation-constraint adherence, participant-level characteristics, and exploratory LLM-based evaluations of haiku authorship. Overall, the findings suggest that as LLMs improve, surface-level creative plausibility may reduce reliable human discrimination within constrained poetic settings. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.AI). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2609.15511 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-15T22:29:03.864Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).