The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles, guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners.
As a repository, the NOAA IR retains documents in their original published format to ensure public access to scientific information.
i
A Rose by Any Other Name: On Basic Scores from the 2 × 2 Table and the Plethora of Names Attached to Them
-
2024
-
Source: Artificial Intelligence for the Earth Systems, 3(2)
[PDF-3.61 MB]
Details:
-
Journal Title:Artificial Intelligence for the Earth Systems
-
Personal Author:
-
NOAA Program & Office:
-
Description:Forecast evaluation metrics have been discovered and rediscovered in a variety of contexts, leading to confusion. We look at measures from the 2 × 2 contingency table and the history of their development and illustrate how different fields working on similar problems has led to different approaches and perspectives of the same mathematical concepts. For example, probability of detection (POD) is a quantity in meteorology that was also called prefigurance in the field, while the same thing is named recall in information science and machine learning, and sensitivity and true positive rate in the medical literature. Many of the scores that combine three elements of the 2 × 2 table can be seen as either coming from a perspective of Venn diagrams or from the Pythagorean means, possibly weighted, of two ratios of performance measures. Although there are algebraic relationships between the two perspectives, the approaches taken by authors led them in different directions, making it unlikely that they would discover scores that naturally arose from the other approach. We close by discussing the importance of understanding the implicit or explicit values expressed by the choice of scores. In addition, we make some simple recommendations about the appropriate nomenclature to use when publishing interdisciplinary work.
-
Source:Artificial Intelligence for the Earth Systems, 3(2)
-
DOI:
-
ISSN:2769-7525
-
Format:
-
Publisher:
-
Document Type:
-
Funding:
-
Rights Information:Other
-
Compliance:Submitted
-
Main Document Checksum:
-
Download URL:
-
File Type:
