loading page

Extracting latent variables from forecast ensembles and advancements in similarity metric utilizing optimal transport
  • Seiya Nishizawa
Seiya Nishizawa
RIKEN Center for Computational Science

Corresponding Author:[email protected]

Author Profile

Abstract

  This study presents a novel methodology for extracting latent variables from high-dimensional sparse data, particularly emphasizing spatial distributions such as precipitation distribution. This approach utilizes multidimensional scaling with a distance matrix derived from a new similarity metric, the Unbalanced Optimal Transport Score (UOTS). UOTS effectively captures discrepancies in spatial distributions while preserving physical units. This is similar to mean absolute error, however it considers location errors, providing a more robust measure crucial for understanding differences between observations, forecasts, and ensembles. Probability distribution estimation of these latent variables enhances the analytical utility, quantifying ensemble characteristics. The adaptability of the method to spatiotemporal data and its ability to handle errors suggest its potential as a promising tool for diverse research applications.
Jun 2024Published in Journal of Geophysical Research: Machine Learning and Computation volume 1 issue 2. 10.1029/2023JH000112