Metraipolis › archive › dc_ea08cc9cde70
Accuracy and Reliability of Large Language Models in Cosmetic Chemistry and Skin Health: A Benchmarking Study — arXiv:2608.14631
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.14631
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-18T17:05:55.197Z
- SHA-256 of the archived text
6550e27c4c3f1fa18511cb26ab764f7a060020ca0248ef0910982f15facde349- Stable URL of this page
https://metraipolis.com/documento/dc_ea08cc9cde70
How to cite
Accuracy and Reliability of Large Language Models in Cosmetic Chemistry and Skin Health: A Benchmarking Study — arXiv:2608.14631 — arXiv (en), https://arxiv.org/abs/2608.14631 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_ea08cc9cde70 (Metraipolis archive dc_ea08cc9cde70, sha256 6550e27c4c3f1fa18511cb26ab764f7a060020ca0248ef0910982f15facde349)
BibTeX
@misc{dcea08cc9cde70,
title = {Accuracy and Reliability of Large Language Models in Cosmetic Chemistry and Skin Health: A Benchmarking Study — arXiv:2608.14631},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.14631},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_ea08cc9cde70; sha256 6550e27c4c3f1fa18511cb26ab764f7a060020ca0248ef0910982f15facde349},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.14631. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
As consumers increasingly turn to AI chatbots for skincare advice, the technical accuracy of Large Language Models (LLMs) in cosmetic chemistry remains largely under-evaluated. We benchmarked 14 LLMs on a structured set of topics related to cosmetic chemistry, including the chemical properties of specific cosmetic ingredients and common cosmetic scenarios that may be of interest to consumers. Web search was disabled throughout to assess each model's internalized knowledge rather than its internet retrieval capacity. Overall performance was poor, with the most pronounced deficits in quantitative reasoning and structural identification tasks. While models handled general skincare questions with reasonability, responses consistently lacked the technical depth required for informed consumer decision-making. Notably, conversation with AI can pose a risk: outputs that sound authoritative but contain technical errors are less likely to generate skepticism compared to responses that explicitly acknowledge uncertainty. These findings suggest that general-purpose LLMs, trained predominantly on unverified public data, are currently not reliable sources of cosmetic chemistry information. Progress on two fronts, fine-tuning verified chemical and dermatological datasets, and substantial improvements to algorithmic reasoning, will likely be needed before these tools can be considered as resources for public use. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-18 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.14631 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-18T16:29:13.717Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-18?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).