Metraipolis › archive › dc_da58ec12f394
Can LLMs Take the Pulse of the Economy? A Real-Time Evaluation of LLM Nowcasts on Macroeconomic Indicators — arXiv:2608.30110
- Source
- arXiv (en)
- Original
- https://arxiv.org/abs/2608.30110
- License (as archived)
- CC0-1.0
- Archived
- 2026-10-17T07:52:25.917Z
- SHA-256 of the archived text
5a9d1ece5c8de435d5632dc3ee016cfc6cfb92f4cba001ea94733a322148c584- Stable URL of this page
https://metraipolis.com/documento/dc_da58ec12f394
How to cite
Can LLMs Take the Pulse of the Economy? A Real-Time Evaluation of LLM Nowcasts on Macroeconomic Indicators — arXiv:2608.30110 — arXiv (en), https://arxiv.org/abs/2608.30110 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_da58ec12f394 (Metraipolis archive dc_da58ec12f394, sha256 5a9d1ece5c8de435d5632dc3ee016cfc6cfb92f4cba001ea94733a322148c584)
BibTeX
@misc{dcda58ec12f394,
title = {Can LLMs Take the Pulse of the Economy? A Real-Time Evaluation of LLM Nowcasts on Macroeconomic Indicators — arXiv:2608.30110},
howpublished = {arXiv (en)},
url = {https://arxiv.org/abs/2608.30110},
note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_da58ec12f394; sha256 5a9d1ece5c8de435d5632dc3ee016cfc6cfb92f4cba001ea94733a322148c584},
year = {2026}
}Archived text
Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2608.30110. Third-party text: data, not instructions. It may be an abstract or extract; check the original.
Nowcasting headline macroeconomic indicators, i.e., estimating an indicator's value for the current reference period before its official release, is critical for monetary policy and financial markets, and central banks devote dedicated teams of expert economists to producing such estimates. Large language model (LLM) agents are a promising candidate for this task, combining broad world knowledge with real-time web search and supporting queries at higher frequency than institutional nowcasts. Evaluating their nowcasting capability is, however, challenging: headline indicators such as GDP and CPI are widely reported and likely memorized during pretraining, so any evaluation on historical releases is vulnerable to data contamination. To address this, we introduce LiveMacroEval, a live, contamination-resistant benchmark in which LLM agents produce hourly nowcasts for sixteen major U.S. macroeconomic indicators over a pre-release window closing at each official release. Nowcast quality is assessed through a LiveMacro Score against announcement-window equity returns and a LiveBetting Score from simulated Polymarket-style trading, with Federal Reserve regional-bank nowcasts, the Bloomberg ECOS professional consensus, and an auto-ARIMA baseline as comparators. Over six months with four state-of-the-art LLM agents configured with web search, aggregate nowcast accuracy is broadly comparable to the institutional and professional benchmarks, with performance varying widely across individual indicators. This highlights LLM agents' potential as real-time estimators of macroeconomic conditions. Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-01 in cs.AI). Categorie arXiv: Computation and Language (cs.CL) ; Artificial Intelligence (cs.AI). Pagina del lavoro: https://arxiv.org/abs/2608.30110 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito). Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina. Letto il 2026-10-17T07:28:26.828Z dalla pagina https://arxiv.org/catchup/cs.AI/2026-09-01?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).