Solar flare forecasting with foundational transformer models across image, video, and time-series modalities
基于基础 Transformer 模型的跨图像、视频与时间序列模态太阳耀斑预报
We present a comparative study of transformer-based architectures for solar flare forecasting using heterogeneous data modalities, including images, video sequences, and time-series observations. Our analysis evaluates three recent foundational models <mml:math><mml:mo>−</mml:mo></mml:math>SigLIP2 for image encoding, VideoMAE for spatio-temporal video representation, and Moirai2 for multivariate time-series forecasting <mml:math><mml:mo>−</mml:mo></mml:math> applied to publicly available datasets of solar magnetograms from the SDO/HMI mission and soft X-ray fluxes acquired by GOES satellites. All models are trained and validated under consistent data splits and evaluation criteria, with the goal of assessing the strengths and limitations of transformer backbones across spatial and temporal representations of solar activity. We investigate multiple loss formulations (weighted BCE, focal, and score-oriented) and training balance strategies to mitigate class imbalance typical of flare datasets. Results show that while both SigLIP2 and VideoMAE achieve typical performance on image and video data (True Skill Statistic TSS <mml:math><mml:mo>∼</mml:mo></mml:math> 0.60─0.65), the time-series model Moirai2 reaches superior forecasting skill (TSS <mml:math><mml:mo>∼</mml:mo></mml:math> 0.74) using irradiance-based temporal evolution alone. These findings highlight the potential of pretrained transformer architectures and cross-modal learning for advancing operational space weather forecasting, paving the way toward unified multimodal models that integrate visual and temporal information.
展开 ▾首次在统一数据划分与评估协议下对比图像、视频、时间序列三类基础 Transformer;Moirai2 仅凭辐照度时间演化即取得 TSS≈0.736,显示日冕响应信号比单帧光球磁图形态更具耀斑前兆判别力。
在耀斑预报从手工特征与统计模型向深度学习演进的过程中,图像方法长期以 SDO/HMI 磁图的卷积网络为主流,Huang+ 2018 与 Sun+ 2023 分别展示了单帧磁图和多波长 EUV 图像的预测能力;视频与时空模型进一步刻画活动区演化,Guastavino+ 2022 和 Li+ 2025 表明时间上下文可带来中等增益但仍受限于短期窗口。时间序列方法则以 SHARP 参数或 GOES XRS 通量建模,Chen+ 2019、Abduallah 2023 和 Donahue & Inceoglu 2024 先后用 LSTM、混合 CNN-Transformer 和纯 Transformer 取得进展。本文在该脉络下首次系统比较三种模态专用基础模型,发现基于辐照度演化的 Moirai2 以 TSS≈0.74 超过图像和视频模型,提示日冕响应时间信号可能比光球磁图形态更直接编码耀斑前兆;未来有望在 Boucheron+ 2023 数据基础上扩充多波长视频与 AR 元数据,发展统一多模态基础模型,把空间拓扑与时间演化端到端融合。
预印本 2025-10-27 · 刊出 2025-12-04 · 收录 2026-08-20