Metraipolis › archive › dc_c83d48365481
A Survey on Evaluation of Large Language Models (2024) · OpenAlex W4391136507
- Source
- OpenAlex
- Original
- https://doi.org/10.1145/3641289
- License (as archived)
- CC-BY-4.0
- Archived
- 2026-10-19T01:34:52.083Z
- SHA-256 of the archived text
9dd49b542c727c497e5e5ac7c122b0b7a7edb361d6b0d4e7a42d8b4b5b7878aa- Stable URL of this page
https://metraipolis.com/documento/dc_c83d48365481
How to cite
A Survey on Evaluation of Large Language Models (2024) · OpenAlex W4391136507 — OpenAlex, https://doi.org/10.1145/3641289 (CC-BY-4.0); archived copy: https://metraipolis.com/documento/dc_c83d48365481 (Metraipolis archive dc_c83d48365481, sha256 9dd49b542c727c497e5e5ac7c122b0b7a7edb361d6b0d4e7a42d8b4b5b7878aa)
BibTeX
@misc{dcc83d48365481,
title = {A Survey on Evaluation of Large Language Models (2024) · OpenAlex W4391136507},
howpublished = {OpenAlex},
url = {https://doi.org/10.1145/3641289},
note = {License CC-BY-4.0; archived copy https://metraipolis.com/documento/dc_c83d48365481; sha256 9dd49b542c727c497e5e5ac7c122b0b7a7edb361d6b0d4e7a42d8b4b5b7878aa},
year = {2026}
}Archived text
Reproduced under CC-BY-4.0. Attribution: OpenAlex, https://doi.org/10.1145/3641289. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Opera scientifica in accesso aperto: scheda dai metadati OpenAlex (article). Titolo: A Survey on Evaluation of Large Language Models Autori: Yupeng Chang, Xu Wang, Jindong Wang, Yuan Wu, Linyi Yang, Kaijie Zhu, Hao Chen, Xiaoyuan Yi e altri 8 Anno: 2024 · Sede: ACM Transactions on Intelligent Systems and Technology · Lingua: en DOI: https://doi.org/10.1145/3641289 Accesso aperto: green · testo: http://arxiv.org/abs/2307.03109 · licenza del testo: cc-by Citazioni ricevute (OpenAlex): 3089 Temi (OpenAlex): Topic Modeling; Natural Language Processing Techniques; Multimodal Machine Learning Applications Abstract (testo degli autori, licenza cc-by): Large language models (LLMs) are gaining increasing popularity in both academia and industry, owing to their unprecedented performance in various applications. As LLMs continue to play a vital role in both research and daily use, their evaluation becomes increasingly critical, not only at the task level, but also at the society level for better understanding of their potential risks. Over the past years, significant efforts have been made to examine LLMs from various perspectives. This paper presents a comprehensive review of these evaluation methods for LLMs, focusing on three key dimensions: what to evaluate , where to evaluate , and how to evaluate . Firstly, we provide an overview from the perspective of evaluation tasks, encompassing general natural language processing tasks, reasoning, medical usage, ethics, education, natural and social sciences, agent applications, and other areas. Secondly, we answer the ‘where’ and ‘how’ questions by diving into the evaluation methods and benchmarks, which serve as crucial components in assessing the performance of LLMs. Then, we summarize the success and failure cases of LLMs in different tasks. Finally, we shed light on several future challenges that lie ahead in LLMs evaluation. Our aim is to offer invaluable insights to researchers in the realm of LLMs evaluation, thereby aiding the development of more proficient LLMs. Our key point is that evaluation should be treated as an essential discipline to better assist the development of LLMs. We consistently maintain the related open-source materials at: https://github.com/MLGroupJLU/LLM-eval-survey Fonte: https://openalex.org/W4391136507 — metadati OpenAlex (CC0 1.0), consultati il 2026-10-19 via api.openalex.org. Interrogazione: «evaluation of large language models».