The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles, guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners.
As a repository, the NOAA IR retains documents in their original published format to ensure public access to scientific information.
i
Can diagnostic tests help identify model misspecification in integrated stock assessments?
-
2017
-
-
Source: Fisheries Research, 192, 28-40
[PDF-2.35 MB]
Details:
-
Journal Title:Fisheries Research
-
Personal Author:
-
NOAA Program & Office:
-
Description:A variety of data types can be included in contemporary integrated stock assessments to simultaneously provide information on all estimated parameters. Conflicts between data, which are often a symptom of model misspecification and evident as model misfit, can affect the estimates of important parameters and derived quantities. Unfortunately, there are few standard diagnostic tools available for integrated stock assessment models that can provide the analyst with all the information needed to determine if there is substantial model misspecification. In this study, we use simulation methods to evaluate the ability of commonly-used and recently-proposed diagnostic tests to detect model misspecification in the observation model process (i.e., the incorrect form for survey selectivity), systems dynamics (i.e., incorrect assumed values for steepness of the stock-recruitment relationship and natural mortality), and incorrect data weighting. The diagnostic tests evaluated here were: i) residuals analysis (SDNR and runs test); ii) retrospective analysis; iii) the R0 likelihood component profile; iv) the age-structured production model (ASPM); and v) catch-curve analysis (CCA). The efficacy of the diagnostic tests depended on whether the misspecification was in the observation or systems dynamics model. Residual analyses were easily the best detector of misspecification of the observation model while the ASPM test was the only good diagnostic for detecting misspecification of system dynamics model. Retrospective analysis and the R0 likelihood component profile infrequently detected misspecified models, and CCA had a high probability of rejecting correctly-specified models. Finally, applying multiple carefully selected diagnostics can increase the power to detect misspecification without substantially increasing the probability of falsely concluding there is misspecification when the model is correctly specified.
-
Keywords:
-
Source:Fisheries Research, 192, 28-40
-
DOI:
-
ISSN:0165-7836
-
Format:
-
Publisher:
-
Document Type:
-
Funding:
-
License:
-
Rights Information:CC BY-NC-ND
-
Compliance:Library
-
Main Document Checksum:
-
Download URL:
-
File Type:
