The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles, guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners.
As a repository, the NOAA IR retains documents in their original published format to ensure public access to scientific information.
i
Taming the data deluge: A novel end‐to‐end deep learning system for classifying marine biological and environmental images
-
2023
-
-
Source: Limnology and Oceanography: Methods, 22(1), 47-64
[PDF-26.69 MB]
Details:
-
Journal Title:Limnology and Oceanography: Methods
-
Personal Author:
-
NOAA Program & Office:
-
Description:Underwater imaging enables nondestructive plankton sampling at frequencies, durations, and resolutions unattainable by traditional methods. These systems necessitate automated processes to identify organisms efficiently. Early underwater image processing used a standard approach: binarizing images to segment targets, then integrating deep learning models for classification. While intuitive, this infrastructure has limitations in handling high concentrations of biotic and abiotic particles, rapid changes in dominant taxa, and highly variable target sizes. To address these challenges, we introduce a new framework that starts with a scene classifier to capture large within‐image variation, such as disparities in the layout of particles and dominant taxa. After scene classification, scene‐specific Mask regional convolutional neural network (Mask R‐CNN) models are trained to separate target objects into different groups. The procedure allows information to be extracted from different image types, while minimizing potential bias for commonly occurring features. Using in situ coastal plankton images, we compared the scene‐specific models to the Mask R‐CNN model encompassing all scene categories as a single full model. Results showed that the scene‐specific approach outperformed the full model by achieving a 20% accuracy improvement in complex noisy images. The full model yielded counts that were up to 78% lower than those enumerated by the scene‐specific model for some small‐sized plankton groups. We further tested the framework on images from a benthic video camera and an imaging sonar system with good results. The integration of scene classification, which groups similar images together, can improve the accuracy of detection and classification for complex marine biological images.
-
Keywords:
-
Source:Limnology and Oceanography: Methods, 22(1), 47-64
-
DOI:
-
ISSN:1541-5856;1541-5856;
-
Format:
-
Publisher:
-
Document Type:
-
Rights Information:Accepted Manuscript
-
Compliance:Library
-
Main Document Checksum:
-
Download URL:
-
File Type:
