Metraipolis › archive › dc_588f470ce0ba
LLMs for Academic Workflows: An Evaluation of Literature Reviews Generated with Short and Long Context Windows of LLMs — arXiv:2608.26145
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.26145
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T14:16:06.574Z
- SHA-256 of the archived text
b2f7af6ff8870d726b708df0efd2c1debc382ef67705b5c2bce1e3b87940d777- Stable URL of this page
https://metraipolis.com/documento/dc_588f470ce0ba
How to cite
LLMs for Academic Workflows: An Evaluation of Literature Reviews Generated with Short and Long Context Windows of LLMs — arXiv:2608.26145 — arXiv (en), https://arxiv.org/abs/2608.26145 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_588f470ce0ba (Metraipolis archive dc_588f470ce0ba, sha256 b2f7af6ff8870d726b708df0efd2c1debc382ef67705b5c2bce1e3b87940d777)
BibTeX
@misc{dc588f470ce0ba,
title = {LLMs for Academic Workflows: An Evaluation of Literature Reviews Generated with Short and Long Context Windows of LLMs — arXiv:2608.26145},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.26145},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_588f470ce0ba; sha256 b2f7af6ff8870d726b708df0efd2c1debc382ef67705b5c2bce1e3b87940d777},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.26145. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Our research focuses on evaluating literature reviews generated in short and long context settings of large language models (LLMs) to investigate the impact of context window on the quality of AI-generated literature reviews and the role of AI in supporting literature review writing. Twenty AI-generated literature reviews based on research sources from Semantic Scholar and Arxiv were evaluated by two researchers across 15 dimensions. Our findings reveal that AI-generated literature reviews require human oversight to meet academic publishing standards. As context windows increase, LLMs can incorporate broader information and maintain coherence across longer inputs, but they also exacerbate issues such as content repetition, omission of critical work, and a tendency towards descriptiveness over synthesis. Our work shows that AI-generated reviews can provide foundational overviews, but their output must be critically evaluated and refined by domain experts. Future research should consider integrating other LLMs and fine-tuned models in different domains with hybrid approaches that combine human expertise with AI capabilities to address the limitations identified in this study. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR). Pagina del lavoro: https://arxiv.org/abs/2608.26145 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T13:16:53.420Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).