Environmental Science

22nd - 23rd September 2022


Bringing the Earth Science and
Transformer communities together

Attention-based neural networks are having a profound impact on areas such as natural language processing and computer vision. Their application to the Earth sciences is still in its infancy but has similar potential, for example, because of the complex nonlocal spatio-temporal interactions in this domain. In this workshop, we want to bring researchers from machine learning (ML) and Earth science together to discuss how transformers and related neural networks can lead to progress in applications such as weather and climate projections, vegetation analysis, remote sensing, downscaling (super resolution), and air pollution predictions. We also want to explore the challenges these applications pose to attention-based ML models, for example, what are appropriate embeddings of the data, what are suitable attention mechanisms and sparsity patterns, and how to represent many interacting physical fields in such architectures.

The workshop will take place in an informal setting on 22nd - 23rd September at Lukasklause conference center in Magdeburg, Germany.


  • Time-series Transformers

  • Vision Transformers

  • Spatio-temporal Transformers

  • Distributed and parallel setup for large-size Transformers

  • Weather forecasting/nowcasting

  • Transformer learning strategies

  • Landcover classification

  • Downscaling/Super resolution

  • Extreme value and anomaly detection

  • Physical interpretation of Transformers


  • Notification: 15th Aug 2022

  • Registration: 1st Sept 2022

  • Workshop: 22nd - 23rd Sept 2022

Please register for the event using this link : and book your hotel room (see accomodation page)

The Speakers

Poster Session