The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles, guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners.
As a repository, the NOAA IR retains documents in their original published format to ensure public access to scientific information.
i
Making the Black Box More Transparent: Understanding the Physical Implications of Machine Learning
-
2019
-
-
Source: Bulletin of the American Meteorological Society, 100(11), 2175-2199
[PDF-23.36 MB]
Details:
-
Journal Title:Bulletin of the American Meteorological Society
-
Personal Author:
-
NOAA Program & Office:
-
Description:This paper synthesizes multiple methods for machine learning (ML) model interpretation and visualization (MIV) focusing on meteorological applications. ML has recently exploded in popularity in many fields, including meteorology. Although ML has been successful in meteorology, it has not been as widely accepted, primarily due to the perception that ML models are “black boxes,” meaning the ML methods are thought to take inputs and provide outputs but not to yield physically interpretable information to the user. This paper introduces and demonstrates multiple MIV techniques for both traditional ML and deep learning, to enable meteorologists to understand what ML models have learned. We discuss permutation-based predictor importance, forward and backward selection, saliency maps, class-activation maps, backward optimization, and novelty detection. We apply these methods at multiple spatiotemporal scales to tornado, hail, winter precipitation type, and convective-storm mode. By analyzing such a wide variety of applications, we intend for this work to demystify the black box of ML, offer insight in applying MIV techniques, and serve as a MIV toolbox for meteorologists and other physical scientists.
-
Keywords:
-
Source:Bulletin of the American Meteorological Society, 100(11), 2175-2199
-
DOI:
-
ISSN:0003-0007;1520-0477;
-
Format:
-
Publisher:
-
Document Type:
-
Funding:
-
Rights Information:Other
-
Compliance:Library
-
Main Document Checksum:
-
Download URL:
-
File Type:
