Metraipolis › archive › dc_3cf6bcd4a047
CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases — arXiv:2608.27391
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.27391
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T14:23:49.452Z
- SHA-256 of the archived text
eddd53f995bbe7735890145ecd865ed99748374983d8245a7e1b1711bd12a1d7- Stable URL of this page
https://metraipolis.com/documento/dc_3cf6bcd4a047
How to cite
CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases — arXiv:2608.27391 — arXiv (en), https://arxiv.org/abs/2608.27391 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_3cf6bcd4a047 (Metraipolis archive dc_3cf6bcd4a047, sha256 eddd53f995bbe7735890145ecd865ed99748374983d8245a7e1b1711bd12a1d7)
BibTeX
@misc{dc3cf6bcd4a047,
title = {CorporateBench: Large-Scale Q&A Benchmarking with Temporal Knowledge Bases — arXiv:2608.27391},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.27391},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_3cf6bcd4a047; sha256 eddd53f995bbe7735890145ecd865ed99748374983d8245a7e1b1711bd12a1d7},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.27391. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
LLMs are increasingly able to answer complex questions about enterprise-scale document collections. But evaluation is hard: companies don't want to share internal communications, and synthetic datasets have been overly simple. We present CorporateBench (CB), a human-validated multi-task Q&A benchmark whose scale approaches the conditions LLMs encounter in corporate communication networks, with evaluation corpora surpassing 230,000 documents. CB evaluates LLMs across two dimensions (information extraction and knowledge base querying) through four synthetically generated firms ranging from 12 to 10,000 employees. Each corpus is sampled from a temporally evolving knowledge base describing a consistent world, guaranteeing cross-document logical consistency even across hundreds of thousands of documents. We evaluate five LLMs on CB, revealing increasingly poor performance as input size approaches realistic scales. CB provides LLM developers a metric for corporate communication reasoning, filling a crucial gap in the benchmarking ecosystem. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-08-28 in cs.AI). Categorie arXiv: Artificial Intelligence (cs.AI) ; Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG). Pagina del lavoro: https://arxiv.org/abs/2608.27391 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T13:16:53.571Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-08-28?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).