Long-Term Performance Metrics for National Weather Service Tornado Warnings
Advanced Search
Select up to three search categories and corresponding keywords using the fields to the right. Refer to the Help section for more detailed instructions.
 
 
i

Superseded

This Document Has Been Replaced By:

i

Retired

This Document Has Been Retired

i

Up-to-date Information

This is the latest update:

Long-Term Performance Metrics for National Weather Service Tornado Warnings
  • Published Date:

    2018

  • Source:
    Wea. Forecasting (2018) 33 (6): 1501–1511.
Filetype[PDF-1.09 MB]


Details:
  • Description:
    Tornado warnings are one of the flagship products of the National Weather Service. We update the time series of various metrics of performance in order to provide baselines over the 1986–2016 period for lead time, probability of detection, false alarm ratio, and warning duration. We have used metrics (mean lead time for tornadoes warned in advance, fraction of tornadoes warned in advance) that work in a consistent way across the official changes in policy for warning issuance, as well as across points in time when unofficial changes took place. The mean lead time for tornadoes warned in advance was relatively constant from 1986 to 2011, while the fraction of tornadoes warned in advance increased through about 2006, and the false alarm ratio slowly decreased. The largest changes in performance take place in 2012 when the default warning duration decreased, and there is an apparent increased emphasis on reducing false alarms. As a result, the lead time, probability of detection, and false alarm ratio all decrease in 2012. Our analysis is based, in large part, on signal detection theory, which separates the quality of the warning system from the threshold for issuing warnings. Threshold changes lead to trade-offs between false alarms and missed detections. Such changes provide further evidence for changes in what the warning system as a whole considers important, as well as highlighting the limitations of measuring performance by looking at metrics independently.
  • Document Type:
  • Place as Subject:
  • Main Document Checksum:
  • File Type:
  • Supporting Files:
    No Additional Files

You May Also Like: