Metraipolis › archive › dc_aa04ef7e4387

Authorship attribution and aesthetic evaluation of AI poetry: a case study with Haiku — arXiv:2609.15511

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.15511
License (as archived)
CC0-1.0
Archived
2026-10-15T22:53:51.670Z
SHA-256 of the archived text
802115be6b0336ed1391c1ca79cb9e4a14d37dfd19ba6bad6d2713acf98de89d
Stable URL of this page
https://metraipolis.com/documento/dc_aa04ef7e4387

How to cite

Authorship attribution and aesthetic evaluation of AI poetry: a case study with Haiku — arXiv:2609.15511 — arXiv (en), https://arxiv.org/abs/2609.15511 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_aa04ef7e4387 (Metraipolis archive dc_aa04ef7e4387, sha256 802115be6b0336ed1391c1ca79cb9e4a14d37dfd19ba6bad6d2713acf98de89d)
BibTeX
@misc{dcaa04ef7e4387,
  title = {Authorship attribution and aesthetic evaluation of AI poetry: a case study with Haiku — arXiv:2609.15511},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.15511},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_aa04ef7e4387; sha256 802115be6b0336ed1391c1ca79cb9e4a14d37dfd19ba6bad6d2713acf98de89d},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.15511. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

This paper investigates the generation and human evaluation of Japanese haiku by contemporary Large Language Models (LLMs), focusing on authorship perception and aesthetic judgment within a constrained poetic form. Using a few-shot prompting strategy, Japanese haiku were generated across a heterogeneous set of large language models, including open- and closed-source systems, medium-scale and large-scale architectures, models with native or adapted Japanese support, and multilingual proprietary models. These AI-generated haiku were combined with human-written ones and presented in a questionnaire distributed to students at Japanese universities in Tokyo. The survey assessed whether respondents could distinguish between AI-generated and human-written haiku and which cues informed their judgments. Recognition accuracy varied across models. GPT-5, Gemini 2.5, and StableLM-7B performed at approximately chance level (approx 0.50), whereas LLM-JP, Gemma-2B, and LLaMA-2 showed moderate detectability (approx 0.59-0.67). However, recognition was strongly item-dependent. Ratings of fluency, coherence, poeticness, and related aesthetic dimensions predicted perceived humanness but not correct classification, indicating an attribution bias linked to aesthetic evaluation and revealing a dissociation between aesthetic evaluation and true authorship detection. The extended analysis additionally examines generation-constraint adherence, participant-level characteristics, and exploratory LLM-based evaluations of haiku authorship. Overall, the findings suggest that as LLMs improve, surface-level creative plausibility may reduce reliable human discrimination within constrained poetic settings.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-15 in cs.AI).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2609.15511 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-15T22:29:03.864Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-15?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).