Inaccuracies with Multimodel Postprocessing Methods Involving Weighted, Regression-Corrected Forecasts

Details

• Journal Title:
  Monthly Weather Review
• Personal Author:
  Hodyss, Daniel ; Satterfield, Elizabeth ; McLay, Justin ; Hamill, Thomas M. ; Scheuerer, Michael
• NOAA Program & Office:
  OAR (Oceanic and Atmospheric Research) ; PSL (Physical Sciences Laboratory) ; ESRL (Earth System Research Laboratory) ; CIRES (Cooperative Institute for Research in Environmental Sciences)
• Description:
  Ensemble postprocessing is frequently applied to correct biases and deficiencies in the spread of ensemble forecasts. Methods involving weighted, regression-corrected forecasts address the typical biases and under-dispersion of ensembles through a regression correction of ensemble members followed by the generation of a probability density function (PDF) from the weighted sum of kernels fit around each corrected member. The weighting step accounts for the situation where the ensemble is constructed from different model forecasts or generated in some way that creates ensemble members that do not represent equally likely states. In the present work, it is shown that an overweighting of climatology in weighted, regression-corrected forecasts can occur when one first performs a regression-based correction before weighting each member. This overweighting of climatology results in an increase in the mean-squared error of the mean of the predicted PDF. The overweighting of climatology is illustrated in a simulation study and a real-data study, where the reference is generated through a direct application of Bayes's rule. The real-data example is a comparison of a particular method referred to as Bayesian model averaging (BMA) and a direct application of Bayes's rule for ocean wave heights using U.S. Navy and National Weather Service global deterministic forecasts. This direct application of Bayes's rule is shown to not overweight climatology and may be a low-cost replacement for the generally more expensive weighted, regression-correction methods.
• Source:
  Monthly Weather Review, 144(4), 1649-1668.
• DOI:
  https://doi.org/10.1175/MWR-D-15-0204.1
• Document Type:
  Journal Article
• Rights Information:
  Other
• Compliance:
  Submitted
• Download URL:
  https://repository.library.noaa.gov/view/noaa/14552/noaa_14552_DS1.pdf
• File Type:
  [PDF - 1.90 MB]
• Collection(s):
  Office of Oceanic and Atmospheric Research (OAR) ; NOAA Cooperative Institutes
• Main Document Checksum:
  urn:sha256:0616e378e82eacb6cde88dc23282afbfe373f9ced093685e5cf38c876bd6d3f5