Metraipolis › archive › dc_15b5b554c824

A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models — arXiv:2610.00969

Source
arXiv (en)
Original
https://arxiv.org/abs/2610.00969
License (as archived)
CC0-1.0
Archived
2026-10-06T12:12:08.586Z
SHA-256 of the archived text
f4f5986ceb989e40254689a9fae9c7f3f41fab7ee78a29d1296292ffdaf3a5db
Stable URL of this page
https://metraipolis.com/documento/dc_15b5b554c824

How to cite

A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models — arXiv:2610.00969 — arXiv (en), https://arxiv.org/abs/2610.00969 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_15b5b554c824 (Metraipolis archive dc_15b5b554c824, sha256 f4f5986ceb989e40254689a9fae9c7f3f41fab7ee78a29d1296292ffdaf3a5db)
BibTeX
@misc{dc15b5b554c824,
  title = {A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models — arXiv:2610.00969},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2610.00969},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_15b5b554c824; sha256 f4f5986ceb989e40254689a9fae9c7f3f41fab7ee78a29d1296292ffdaf3a5db},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2610.00969. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Large language models (LLMs) have been increasingly used for financial document analysis, including earnings call transcripts (ECTs). Beyond generating standalone claims, users increasingly prefer grounded analyses that pair claims with verifiable citations from source documents to enable independent validation. However, evaluating such analytical claims typically requires extensive expert annotation, which is costly and difficult to scale, and real-world financial analysis commonly involves long context-question-answer triplets, further increasing task complexity. To address these challenges and benchmark the current landscape of grounded analysis by LLMs, we propose a numeric evidence evaluation method that enables groundedness assessment without reliance on expert annotation. We also introduce an automated dataset construction pipeline and construct ECTs-100 from the top 100 constituents of the S&P 500 to support benchmark of both groundedness and correctness. In addition, we examine conscious incompetence, a practical failure mode in financial analysis in which LLMs must detect when available evidence is insufficient and refrain from producing unsupported hallucinations. Empirical results show that LLMs perform well in groundedness but face notable limitations in correctness, with informational insufficiency presenting an additional challenge.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-10-02 in cs.AI).
Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI).
Pagina del lavoro: https://arxiv.org/abs/2610.00969 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-06T10:21:28.138Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-10-02?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).