Proceedings

HighFM: Towards a Foundation Model for Learning Representations from High-Frequency Earth Observation Data

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. AI and Social Good. Pages 7156-7164.

https://doi.org/10.24963/ijcai.2026/796

Abstract

The increasing frequency and severity of climate-related disasters have intensified the need for real-time monitoring, early warning, and informed decision-making. Earth Observation (EO), powered by satellite data and Machine Learning (ML), offers powerful tools to meet these challenges. Foundation Models (FMs) have revolutionized EO ML by enabling general-purpose pretraining on large-scale remote sensing datasets. However most existing models rely on high-resolution satellite imagery with low revisit rates, limiting their suitability for fast-evolving phenomena and time-critical emergency response. In this work, we present HighFM, a first cut approach towards a FM for high-temporal-resolution, multispectral EO data. Leveraging over 2 TB of SEVIRI imagery from the Meteosat Second Generation (MSG) platform, we adapt the SatMAE masked autoencoding framework to learn robust spatiotemporal representations. To support real-time monitoring, we enhance the original architecture with fine-grained temporal encodings to capture short-term variability. The pretrained models are then fine-tuned on cloud masking and active fire detection tasks. We benchmark our SEVIRI-pretrained Vision Transformers against traditional baselines and recent geospatial FMs, demonstrating consistent gains across both balanced accuracy and IoU metrics. Our results highlight the potential of temporally dense geostationary data for real-time EO, offering a scalable path toward foundation models for disaster detection and tracking.

  1. [Awais et al., 2023] Muhammad Awais, Muzammal Naseer, Salman Khan, Rao Muhammad Anwer, Hisham Cholakkal, Mubarak Shah, Ming-Hsuan Yang, and Fahad Shahbaz Khan. Foundational models defining a new era in vision: A survey and outlook, 2023.
  2. [Bountos et al., 2025] Nikolaos Ioannis Bountos, Arthur Ouaknine, Ioannis Papoutsis, and David Rolnick. Fomo: Multi-modal, multi-scale and multi-task remote sensing foundation models for forest monitoring, 2025.
  3. [Chabrillat et al., 2024] Sabine Chabrillat, Stefan Foerster, Karl Segl, Alice Beamish, Maximilian Brell, Saeed Asadzadeh, Robert Milewski, Kevin J. Ward, Arne Brosin- sky, Karin Koch, Daniel Scheffler, Stéphane Guillaso, Alexander Kokhanovsky, Sigrid Roessner, Luis Guan- ter, Hermann Kaufmann, Nicole Pinnel, Emilio Carmona, Thomas Storch, Tobias Hank, Kai Berger, Martin Wocher, Patrick Hostert, Sebastian van der Linden, Abubakar Oku- jeni, Alexander Janz, Benjamin Jakimow, Astrid Bracher, Maren A. Soppa, L. M. Alejandra Alvarado, Henning Bud- denbaum, Birgit Heim, Uta Heiden, José Moreno, Chang Ong, Nina Bohn, Robert O. Green, Martin Bachmann, Raymond Kokaly, Michael Schodlok, Thomas H. Painter, Ferran Gascon, Fabrizio Buongiorno, Matti Mottus, Vic- tor E. Brando, Hannes Feilhauer, Markus Betz, Sebastian Baur, Ralph Feckl, Andreas Schickling, Volker Krieger, Markus Bock, Laura La Porta, and Stefan Fischer. The enmap spaceborne imaging spectroscopy mission: Initial scientific results two years after launch. Remote Sensing of Environment, 315:114379, 2024.
  4. [Cong et al., 2022] Yezhen Cong, Samar Khanna, Chenlin Meng, Patrick Liu, Erik Rozi, Yutong He, Marshall Burke, David B. Lobell, and Stefano Ermon. Satmae: Pre-training transformers for temporal and multi-spectral satellite im- agery. In Advances in Neural Information Processing Sys- tems (NeurIPS), 2022. arXiv:2207.08051.
  5. [Copernicus Atmosphere Monitoring Service, 2021] Copernicus Atmosphere Monitoring Service. CAMS Global Atmospheric Composition Forecasts. https://ads.atmosphere.copernicus.eu/, 2021. Copernicus Atmosphere Monitoring Service (CAMS) Atmosphere Data Store. DOI: 10.24381/04a0b097. Accessed on 14-Jul-2025. DOI
  6. [Diao et al., 2025] Wenhui Diao, Haichen Yu, Kaiyue Kang, Tong Ling, Di Liu, Yingchao Feng, Hanbo Bi, Libo Ren, Xuexue Li, Yongqiang Mao, and Xian Sun. Ringmo- aerial: An aerial remote sensing foundation model with affine transformation contrastive learning, 2025.
  7. [Dosovitskiy et al., 2021] Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Min- derer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. An image is worth 16x16 words: Trans- formers for image recognition at scale. In 9th International Conference on Learning Representations, ICLR 2021, Vir- tual Event, Austria, May 3-7, 2021, 2021.
  8. [Girtsou et al., 2024] Stella Girtsou, Emiliano Diaz Salas- Porras, Lilli Freischem, Joppe Massant, Kyriaki-Margarita Bintsi, Giuseppe Castiglione, William Jones, Michael Eisinger, J. Emmanuel Johnson, and Anna Jungbluth. 3d cloud reconstruction through geospatially-aware masked autoencoders. In NeurIPS 2024 Workshop on Machine Learning and the Physical Sciences, 2024. Poster.
  9. [He et al., 2021] Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, and Ross Girshick. Masked au- toencoders are scalable vision learners, 2021.
  10. [Huo et al., 2025] Chenyu Huo, Ke Chen, Shu Zhang, Zhenyu Wang, Hongyuan Yan, Jianbing Shen, Yong Hong, Guojin Qi, Hong Fang, and Zongming Wang. When re- mote sensing meets foundation model: A survey and be- yond. Remote Sensing, 17(2):179, 2025.
  11. [Khanna et al., 2024] Samar Khanna, Patrick Liu, Linqi Zhou, Chenlin Meng, Robin Rombach, Marshall Burke, David B. Lobell, and Stefano Ermon. Diffusionsat: A generative foundation model for satellite imagery. In The Twelfth International Conference on Learning Represen- tations, 2024.
  12. [Kontoes et al., 2016] Christos Kontoes, Ioannis Papout- sis, Theodoros Herekakis, Eleni Ieronymidi, and Irene Keramitsoglou. Remote sensing techniques for forest fire disaster management: The firehub operational platform. In Integrating Scale in Remote Sensing and GIS, pages 157- 188. CRC Press, 2016.
  13. [Lu et al., 2025] Siqi Lu, Junlin Guo, James R. Zimmer- Dauphinee, Jordan M. Nieusma, Xiao Wang, Parker van- Valkenburgh, Steven A. Wernke, and Yuankai Huo. Vision foundation models in remote sensing: A survey. IEEE Geoscience and Remote Sensing Magazine, pages 2-27, 2025. [
  14. [OpenAI, 2024] OpenAI. Gpt-4 technical report, 2024.
  15. [Radford et al., 2021] Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agar- wal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervi- sion, 2021.
  16. [Reed et al., 2023] Colorado J. Reed, Ritwik Gupta, Shufan Li, Sarah Brockman, Christopher Funk, Brian Clipp, Kurt Keutzer, Salvatore Candido, Matt Uyttendaele, and Trevor Darrell. Scale-mae: A scale-aware masked autoencoder for multiscale geospatial representation learning, 2023.
  17. [Ronneberger et al., 2015] Olaf Ronneberger, Philipp Fis- cher, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention -MICCAI 2015 -18th International Conference Munich, Germany, October 5 -9, 2015, Proceedings, Part III, volume 9351, pages 234-241. Springer, 2015.
  18. [Schmitt et al., 2019] Michael Schmitt, Lloyd Haydn Hughes, Chunping Qiu, and Xiao Xiang Zhu. Sen12ms -a curated dataset of georeferenced multi-spectral sentinel-1/2 imagery for deep learning and data fusion, 2019.
  19. [Spradlin et al., 2024] Caleb S. Spradlin, Jordan A. Caraballo-Vega, Jian Li, Mark L. Carroll, Jie Gong, and Paul M. Montesano. Satvision-toa: A geospatial foundation model for coarse-resolution all-sky remote sensing imagery, 2024.
  20. [Sumbul et al., 2019] Gencer Sumbul, Marcela Charfuelan, Begum Demir, and Volker Markl. Bigearthnet: A large- scale benchmark archive for remote sensing image under- standing. In IGARSS 2019 -2019 IEEE International Geo- science and Remote Sensing Symposium. IEEE, July 2019.
  21. [Szwarcman et al., 2025] Daniela Szwarcman, Sujit Roy, Paolo Fraccaro, Thorsteinn Elí Gíslason, Benedikt Blu- menstiel, Rinki Ghosal, Pedro Henrique de Oliveira, Joao Lucas de Sousa Almeida, Rocco Sedona, Yanghui Kang, Srija Chakraborty, Sizhe Wang, Carlos Gomes, Ankur Kumar, Myscon Truong, Denys Godwin, Hyunho Lee, Chia-Yu Hsu, Ata Akbari Asanjan, Besart Mujeci, Disha Shidham, Trevor Keenan, Paulo Arevalo, Wen- wen Li, Hamed Alemohammad, Pontus Olofsson, Christo- pher Hain, Robert Kennedy, Bianca Zadrozny, David Bell, Gabriele Cavallaro, Campbell Watson, Manil Maskey, Rahul Ramachandran, and Juan Bernabe Moreno. Prithvi- eo-2.0: A versatile multi-temporal foundation model for earth observation applications, 2025.
  22. [Tang et al., 2024] Datao Tang, Xiangyong Cao, Xingsong Hou, Zhongyuan Jiang, Junmin Liu, and Deyu Meng. Crs- diff: Controllable remote sensing image generation with diffusion model, 2024.
  23. [Tian et al., 2024] Jiayuan Tian, Jie Lei, Jiaqing Zhang, Weiying Xie, and Yunsong Li. Swimdiff: Scene-wide matching contrastive learning with diffusion constraint for remote sensing image, 2024.
  24. [Waldmann et al., 2025] Leonard Waldmann, Ando Shah, Yi Wang, Nils Lehmann, Adam Stewart, Zhitong Xiong, Xiao Xiang Zhu, Stefan Bauer, and John Chuang. Panop- ticon: Advancing any-sensor foundation models for earth observation. In Proceedings of the Computer Vision and Pattern Recognition Conference (CVPR) Workshops, pages 2204-2214, 2025.
  25. [Wang et al., 2023] Yi Wang, Hugo Hernández Hernández, Conrad M Albrecht, and Xiao Xiang Zhu. Feature guided masked autoencoder for self-supervised learning in remote sensing, 2023.
  26. [Wang et al., 2024a] Yi Wang, Conrad M Albrecht, Nas- sim Ait Ali Braham, Chenying Liu, Zhitong Xiong, and Xiao Xiang Zhu. Decoupling common and unique repre- sentations for multimodal self-supervised learning, 2024.
  27. [Wang et al., 2024b] Yi Wang, Conrad M Albrecht, and Xiao Xiang Zhu. Multi-label guided soft contrastive learn- ing for efficient earth observation pretraining, 2024.
  28. [Wang et al., 2025] Yi Wang, Zhitong Xiong, Chenying Liu, Adam J. Stewart, Thomas Dujardin, Nikolaos Ioannis Bountos, Angelos Zavras, Franziska Gerken, Ioannis Pa- poutsis, Laura Leal-Taixé, and Xiao Xiang Zhu. Towards a unified copernicus foundation model for earth vision, 2025.
  29. [Xiong et al., 2024] Zhitong Xiong, Yi Wang, Fahong Zhang, and Xiao Xiang Zhu. One for all: Toward unified foundation models for earth vision, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards