Details:

Personal Author:
Jacobson, Eiren K. ; Yack, Tina M. ; Barlow, Jay
Jacobson, Eiren K. ; Yack, Tina M. ; Barlow, Jay Less -
Corporate Authors:
Southwest Fisheries Science Center (U.S.)
NOAA Program & Office:
NMFS (National Marine Fisheries Service) ; SWFSC (Southwest Fisheries Science Center)
NMFS (National Marine Fisheries Service) ; SWFSC (Southwest Fisheries Science Center) Less -
Description:
"Currently, the acoustic detection of beaked whales during passive acoustic surveys requires trained acousticians to identify beaked whale signals with the aid of various software programs. The development of reliable automated detection and classification methods will enable passive acoustic approaches to better meet monitoring needs for real-time mitigation of industry and military impacts. During ongoing development of automated beaked whale detectors and classifiers it will be important for researchers at different institutions to utilize standardized metrics of performance. At the Southwest Fisheries Science Center (SWFSC), automated detection algorithms for Cuvier's beaked whale (Ziphius cavirostris) and Baird's beaked whale (Berardius bairdii) were developed using PAMGUARD software (Douglas Gillespie: www.pamguard.org). To evaluate the performance of these beaked whale detectors, 15 ten-minute recording segments were processed in PAMGUARD, and the resulting signal detections were compared to manual logs of beaked whale signals confirmed by an experienced acoustician. The comparison was conducted using three methods: precise timestamp matching between manual and automated detections, detection counts from one-minute time bins, and binary presence/absence detection classification of one-minute bins. The detections were scored as true positive, false positive, false negative or false classification. Detector efficacy was quantified using measures developed for information retrieval systems (precision, recall, and F-score) as well as the Receiver Operating Characteristic. Calculated performance scores were compared across evaluation methods. We found that the method used to evaluate detector functionality greatly influences the resulting performance scores and subsequently our perception of detector ability. Therefore, it will be important for researchers to clearly communicate methods and results of detector evaluation. To allow for greatest precision and applicability to different recording datasets, we recommend that beaked whale detectors be evaluated using timestamp matching between manual and automated detections in trial datasets and that F-scores be used to compare detectors. This approach avoids problems associated with binning datasets by eliminating the need for a measure of false negatives"--Abstract.
Content Notes:
Eiren K. Jacobson, Tina M. Yack, Jay Barlow.

"March 2013."

System requirements: Adobe Acrobat Reader.

Includes bibliographical references (pages 17-19).


Keywords:
[+]
Beaked Whales Detection Management Marine Mammals Methodology Monitoring Underwater Acoustics
Series:
NOAA technical memorandum NMFS ; NOAA-TM-NMFS-SWFSC ; 509
NOAA technical memorandum NMFS ; NOAA-TM-NMFS-SWFSC ; 509 Less -
Document Type:
Technical Memorandum
Place as Subject:
United States
Rights Information:
Public Domain
Compliance:
Library
Main Document Checksum:
[+]
urn:sha256:b25457ac9b2be2606c26f85d75c5c952440962f86b1bc1baab9de89606788c57
Download URL:
https://repository.library.noaa.gov/view/noaa/4462/noaa_4462_DS1.pdf
File Type:

Supporting Files

• No Additional Files

More +