Abstract
Self-supervised learning (SSL) provides an innovative paradigm for pretraining without involving any new data or labels. However, its potential has not yet been evaluated in the field of typhoon raincloud nowcasting. Therefore, we explore two different SSL approaches: autoencoder (AE) and masked autoencoder (MAE). Both are then paired with a subsequent adaptation strategy, namely fine-tuning (FT). We evaluate the performance gains from different combinations using the popular U-Net backbone across multiple evaluation metrics. The results show that both AE-FT and MAE-FT outperform control experiments (Ctrl), where the U-Net is trained from scratch without SSL. The AE-FT yields a root mean square error of 6.56, around 2.6% improvement compared to Ctrl (6.72), whereas the MAE-FT excels in extreme event detection, achieving a Heidke Skill Score of 0.12 at the 40 dBZ threshold, 50.7% higher than Ctrl (0.08). Comparison with rotation-based data augmentation further validates the merits of SSL for pretraining, which stem from enrichment of learned representations in general and geospatial sharpness induced by masking strategies. However, the choice of loss function used in SSL greatly impacts its effectiveness, and a perceptually sensitive loss function like structure similarity (SSIM) loss is more desirable than the traditional mean square error (MSE) loss.
| Original language | English |
|---|---|
| Article number | e2025JH001191 |
| Journal | Journal of Geophysical Research: Machine Learning and Computation |
| Volume | 3 |
| Issue number | 3 |
| DOIs | |
| Publication status | Published - Jun 2026 |
UN SDGs
This output contributes to the following UN Sustainable Development Goals (SDGs)
-
SDG 9 Industry, Innovation, and Infrastructure
Keywords
- data augmentation
- fine-tuning
- nowcasting
- pretraining
- self-supervised learning
- tropical cyclone
Fingerprint
Dive into the research topics of 'Self-Supervised Radar Nowcasting of Typhoon Cloud Evolution'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver