Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Ensemble neural network forecasts with singular value decomposition
Stockholm University, Faculty of Science, Department of Meteorology .ORCID iD: 0000-0002-6314-8833
Stockholm University, Faculty of Science, Department of Meteorology . Uppsala University, Sweden.
(English)Manuscript (preprint) (Other academic)
Abstract [en]

Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast by computing the ensemble's spread. However, generating an ensemble with a good error-spread relationship is far from trivial, and a wide range of approaches to achieve this have been explored. Random perturbations of the initial model state typically provide unsatisfactory results when applied to numerical weather prediction models. Singular value decomposition has proved more successful in this context, and as a result has been widely used for creating perturbed initial states of weather prediction models. We demonstrate how to apply the technique of singular value decomposition to purely neural-network based forecasts. Additionally, we explore the use of random initial perturbations for neural network ensembles, and the creation of neural network ensembles via retraining the network. We find that the singular value decomposition results in ensemble forecasts that have some probabilistic skill, but are inferior to the ensemble created by retraining the neural network several times. Compared to random initial perturbations, the singular value technique performs better when forecasting a simple general circulation model, comparably when forecasting atmospheric reanalysis data, and worse when forecasting the lorenz95 system - a highly idealized model designed to mimic certain aspects of the mid-latitude atmosphere.

National Category
Meteorology and Atmospheric Sciences
Research subject
Atmospheric Sciences and Oceanography
Identifiers
URN: urn:nbn:se:su:diva-180872OAI: oai:DiVA.org:su-180872DiVA, id: diva2:1424494
Available from: 2020-04-17 Created: 2020-04-17 Last updated: 2025-02-07
In thesis
1. Artificial intelligence in weather and climate prediction: Learning atmospheric dynamics
Open this publication in new window or tab >>Artificial intelligence in weather and climate prediction: Learning atmospheric dynamics
2020 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Weather and climate prediction is dominated by high dimensionality, interactions on many different spatial and temporal scales and chaotic dynamics. This makes many problems in the field quite complex ones, and also state-of-the-art numerical models are - despite their immense computational costs - not sufficient for many applications. Therefore, it is appealing to use emerging new technologies such as artificial intelligence to tackle these problems.

We show that it is possible to use deep neural networks to emulate the full dynamics of a strongly simplified general circulation model, providing both good forecasts of the model state several days ahead as well as stable long-term climate timeseries. This method partly also works on more complex and realistic models, but only for forecasting the model's weather several days ahead, not for creating climate runs. It is sufficient to use 50-100 years of data for training the networks. The same neural network method can be combined with singular value decomposition from numerical ensemble weather forecasting in order to generate probabilistic ensemble forecasts with the neural networks.

On a more fundamental level, we show that in a simple dynamical systems setting there seem to be limitations in the ability of feed-forward neural networks to generalize to new regions of the system. This is caused by different parts of the network learning to model different parts of the system. Contradictory, for another simple dynamical system this is shown not to be an issue, raising doubts on the usefulness of results from simple models in the context of more complex ones. Additionally, we show that neural networks are to some extent able to “learn” the influence of slowly changing external forcings on the dynamics of the system, but only given broad enough forcing regimes.

Finally, we present a method to complement operational weather forecasts. Given the initial fields and the error of past weather forecasts, a neural network is used to predict the uncertainty in new forecasts, given only the initial field of the new forecast.

Place, publisher, year, edition, pages
Stockholm: Department of Meteorology, Stockholm University, 2020. p. 30
National Category
Meteorology and Atmospheric Sciences
Research subject
Atmospheric Sciences and Oceanography
Identifiers
urn:nbn:se:su:diva-180877 (URN)978-91-7911-128-1 (ISBN)978-91-7911-129-8 (ISBN)
Public defence
2020-06-12, Vivi Täckholmsalen (Q-salen), Svante Arrhenius väg 20, Stockholm, 10:00 (English)
Opponent
Supervisors
Funder
Swedish Research Council, 2016-03724
Note

At the time of the doctoral defense, the following paper was unpublished and had a status as follows: Paper 4: Manuscript.

Available from: 2020-05-18 Created: 2020-04-20 Last updated: 2025-02-07Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

arXiv:2002.05398

Authority records

Scher, SebastianMessori, Gabriele

Search in DiVA

By author/editor
Scher, SebastianMessori, Gabriele
By organisation
Department of Meteorology
Meteorology and Atmospheric Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 517 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf