Understanding Spatial Context in Convolutional Neural Networks using Explainable Methods: Application to Interpretable GREMLIN
-
-
-
Source:
Details
-
Journal Title:Artificial Intelligence for the Earth Systems
-
NOAA Program & Office:
-
Description:Convolutional neural networks (CNNs) are opening new possibilities in the realm of satellite remote sensing. CNNs are especially useful for capturing the information in spatial patterns that is evident to the human eye but has eluded classical pixelwise retrieval algorithms. However, the black box nature of CNN predictions makes them difficult to interpret, hindering their trustworthiness. This paper explores a new way to simplify CNNs that allows them to be implemented in a fully transparent and interpretable framework. This clarity is accomplished by moving the inner workings of the CNN out into a feature engineering step and replacing the CNN with a regression model. The specific example of GREMLIN (GOES Radar Estimation via Machine Learning to Inform NWP) is used to demonstrate that such simplifications are possible and show the benefits of the interpretable approach. GREMLIN translates images of GOES radiances and lightning into images of radar reflectivity, and previous research used Explainable AI (XAI) approaches to explain some aspects of how GREMLIN makes predictions. However, the Interpretable GREMLIN model shows that XAI missed several strategies, and XAI does not provide guarantees on how the model will respond when confronted with new scenarios. In contrast, the interpretable model establishes well defined relationships between inputs and outputs, offering a clear mapping of the spatial context utilized by the CNN to make accurate predictions; and providing guarantees on how the model will respond to new inputs. The significance of this work is that it provides a new approach for developing trustworthy AI models.
-
DOI:
-
ISSN:2769-7525
-
Format:
-
Publisher:
-
Document Type:
-
Funding:
-
Rights Information:Other
-
Compliance:Library
-
Download URL:
-
File Type:
-
Collection(s):
-
Main Document Checksum:urn:sha256:adcb3155ff85ff7cb4d52763b7d765cdcdc7061fbec5682df8a667a7964fe16e
The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles,
guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners. As a repository, the
NOAA IR retains documents in their original published format to ensure public access to scientific information.