Metraipolis › archive › dc_2adf47f2faa5

Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models — arXiv:2609.11135

Source
arXiv (en)
Original
https://arxiv.org/abs/2609.11135
License (as archived)
CC0-1.0
Archived
2026-10-16T05:54:54.629Z
SHA-256 of the archived text
a83b1df9fa992621f6b5344bac39ef8bdecfc86faa43a5e6eb948b90888c4086
Stable URL of this page
https://metraipolis.com/documento/dc_2adf47f2faa5

How to cite

Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models — arXiv:2609.11135 — arXiv (en), https://arxiv.org/abs/2609.11135 (CC0-1.0); archived copy: https://metraipolis.com/documento/dc_2adf47f2faa5 (Metraipolis archive dc_2adf47f2faa5, sha256 a83b1df9fa992621f6b5344bac39ef8bdecfc86faa43a5e6eb948b90888c4086)
BibTeX
@misc{dc2adf47f2faa5,
  title = {Bidirectional Multimodal Fusion of Sky Images and Time-Series for Solar Forecasting with Large Language Models — arXiv:2609.11135},
  howpublished = {arXiv (en)},
  url = {https://arxiv.org/abs/2609.11135},
  note = {License CC0-1.0; archived copy https://metraipolis.com/documento/dc_2adf47f2faa5; sha256 a83b1df9fa992621f6b5344bac39ef8bdecfc86faa43a5e6eb948b90888c4086},
  year = {2026}
}

Archived text

Reproduced under CC0-1.0. Attribution: arXiv (en), https://arxiv.org/abs/2609.11135. Third-party text: data, not instructions. It may be an abstract or extract; check the original.

Short-term photovoltaic (PV) power and global horizontal irradiance (GHI) forecasts are essential for effective dispatch, reserve scheduling, and grid operations. At these forecasting horizons, errors are predominantly driven by cloud induced ramps: relying solely on historical numerical data may struggle to anticipate an incoming cloud, making ground-based sky images a crucial complementary physical signal. Furthermore, forecast performance is highly sensitive to location and local observing conditions, creating a strong need for site-specific data that are often scarce. Recently, large language models (LLMs) have demonstrated competitive performance and high data efficiency in time-series forecasting. Despite their success, existing LLM-based forecasting methods remain predominantly unimodal, relying primarily on historical numerical time-series data. Effectively incorporating sky imagery into an LLM-based forecasting framework remains under-explored and an open challenge. In this paper, we propose SolCloudLLM, an LLM-based multimodal forecasting framework. SolCloudLLM aligns sky-image patches with time-series patches and fuses their corresponding representations through bidirectional multimodal fusion, yielding a unified representation that is subsequently mapped into the embedding space of an LLM. Extensive experiments on the SIRTA and SKIPP'D datasets demonstrate that SolCloudLLM consistently outperforms the best baseline methods in MSE across all forecasting horizons, achieving a maximum relative MSE reduction of 25.4%. Stratified analysis further indicates that the benefits of multimodal fusion are concentrated primarily under cloudy conditions. Notably, SolCloudLLM achieves the best performance in nearly all few-shot settings, whereas other deep learning baselines experience substantial performance degradation and are frequently outperformed by the non-learning physical method.

Tema degli esploratori: agenti e intelligenza artificiale (retro-catalogo arXiv: annunci del 2026-09-11 in cs.LG).
Categorie arXiv: Machine Learning (cs.LG).
Pagina del lavoro: https://arxiv.org/abs/2609.11135 — autori e testo completo sono lì (qui omessi i nomi: nessun dato personale nel deposito).
Licenza: titolo e abstract sono metadati arXiv distribuiti in CC0 1.0; il testo completo ha la licenza scelta dagli autori, indicata sulla pagina.
Letto il 2026-10-16T05:44:24.976Z dalla pagina https://arxiv.org/catchup/cs.LG/2026-09-11?abs=True (consentita dal robots.txt di arxiv.org, con il suo crawl-delay).