Can deep learni… (2021-02-15T00:00:00.000000Z)

TL;DR

It is thought that it is not inconceivable that numerical weather models may one day become obsolete, but a number of fundamental breakthroughs are needed before this goal comes into reach.

Abstract

The recent hype about artificial intelligence has sparked renewed interest in applying the successful deep learning (DL) methods for image recognition, speech recognition, robotics, strategic games and other application areas to the field of meteorology. There is some evidence that better weather forecasts can be produced by introducing big data mining and neural networks into the weather prediction workflow. Here, we discuss the question of whether it is possible to completely replace the current numerical weather models and data assimilation systems with DL approaches. This discussion entails a review of state-of-the-art machine learning concepts and their applicability to weather data with its pertinent statistical properties. We think that it is not inconceivable that numerical weather models may one day become obsolete, but a number of fundamental breakthroughs are needed before this goal comes into reach. This article is part of the theme issue ‘Machine learning for weather and climate modelling’.

Authors

M. Schultz

1 papers

C. Betancourt

1 papers

B. Gong

1 papers

TL;DR

Abstract

Authors

References152 items

Learning Under Concept Drift

Deep Learning Based Multistep Solar Forecasting for PV Ramp-Rate Control Using Sky Images

IntelliO3-ts v1.0: A neural network approach to predict near-surface ozone concentrations in Germany

Unsupervised Deep Learning of Incompressible Fluid Dynamics

Neural Networks Fail to Learn Periodic Functions and How to Fix It

Disentangling Physical Dynamics From Unknown Factors for Unsupervised Video Prediction

Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model

Modeling Cloud Reflectance Fields using Conditional Generative Adversarial Networks

WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting

Discovering the Importance of Mesoscale Cloud Organization Through Unsupervised Classification

Learning under Concept Drift: A Review

Interpretable Deep Learning for Spatial Analysis of Severe Hailstorms

DINCAE 1.0: a convolutional neural network with error estimates to reconstruct sea surface temperature satellite observations

An Introduction to Variational Autoencoders

SinGAN: Learning a Generative Model From a Single Natural Image

Satellite Image Prediction Relying on GAN and LSTM Neural Networks

Advancements in Hurricane Prediction With NOAA's Next‐Generation Forecast System

Assessment of wavelet-based spatial verification by means of a stochastic precipitation model (wv_verif v0.1.0)

Unmasking Clever Hans predictors and assessing what machines really learn

Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations

Deep learning and process understanding for data-driven Earth system science

Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data

Memory in Memory: A Predictive Neural Network for Learning Higher-Order Non-Stationarity From Spatiotemporal Dynamics

KloudNet: Deep Learning for Sky Image Analysis and Irradiance Forecasting

Physics Guided RNNs for Modeling Dynamical Systems: A Case Study in Simulating Lake Temperature Profiles

Discretization of generalized Coriolis and friction terms on the deformed hexagonal C‐grid

The Setup of the MesoVICT Project

Correlated Time Series Forecasting using Deep Neural Networks: A Summary of Results

Weather Recognition Based on Edge Deterioration and Convolutional Neural Networks

Challenges and design choices for global weather and climate models based on machine learning

Using Machine Learning to Parameterize Moist Convection: Potential for Modeling of Climate, Climate Change, and Extreme Events

Neural networks for post-processing ensemble weather forecasts

Processing of missing data by neural networks

Stochastic Adversarial Video Prediction

Hourly day-ahead solar irradiance prediction using weather forecasts by LSTM

Continual Lifelong Learning with Neural Networks: A Review

Quantifying Uncertainty in Discrete-Continuous and Skewed Data with Bayesian Deep Learning

PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs

Deep learning for physical processes: incorporating prior scientific knowledge

Generalization without Systematicity: On the Compositional Skills of Sequence-to-Sequence Recurrent Networks

Physics-guided Neural Networks (PGNN): An Application in Lake Temperature Modeling

The growing impact of satellite observations sensitive to humidity, cloud and precipitation

Learning to Generate Time-Lapse Videos Using Multi-stage Dynamic Generative Adversarial Networks

Concrete Problems for Autonomous Vehicle Safety: Advantages of Bayesian Deep Learning

Review of wind power forecasting methods: From multi-spatial and temporal perspective

Nonparametric Variational Auto-Encoders for Hierarchical Representation Learning

Deep Bayesian Active Learning with Image Data

Intercomparison of machine learning methods for statistical downscaling: the case of daily and extreme precipitation

A Mass-Flux Cumulus Parameterization Scheme across Gray-Zone Resolutions

Image De-Raining Using a Conditional Generative Adversarial Network

Theory-Guided Data Science: A New Paradigm for Scientific Discovery from Data

Polarimetric SAR Image Classification Using Deep Convolutional Neural Networks

Image-to-Image Translation with Conditional Adversarial Networks

PixelVAE: A Latent Variable Model for Natural Images

Towards Bayesian Deep Learning: A Framework and Some Existing Methods

Generative Adversarial Text to Image Synthesis

Spatial verification using wavelet transforms: a review

Context Encoders: Feature Learning by Inpainting

Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks

Assimilation of Mode-S EHS Aircraft Observations in COSMO-KENDA

Towards Bayesian Deep Learning: A Survey

Kilometre‐scale ensemble data assimilation for the COSMO model (KENDA)

Perceptual Losses for Real-Time Style Transfer and Super-Resolution

Fast atmospheric response to a sudden thinning of Arctic sea ice

Mastering the game of Go with deep neural networks and tree search

Human-level concept learning through probabilistic program induction

Deep Residual Learning for Image Recognition

Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin

Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

Adversarial Autoencoders

Deep multi-scale video prediction beyond mean square error

The quiet revolution of numerical weather prediction

A Deep Hybrid Model for Weather Forecasting

Action-Conditional Video Prediction using Deep Networks in Atari Games

Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting

Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning