An iterative labeling method for annotating marine life imagery

Zhang, Zhiyong; Kaveti, Pushyami; Singh, Hanumant; Powell, Abigail; Fruh, Erica; Clarke, M. Elizabeth

doi:10.3389/fmars.2023.1094190

i

An iterative labeling method for annotating marine life imagery

2023
By Zhang, Zhiyong ; Kaveti, Pushyami ; Singh, Hanumant ; ...

Select the Download button to view the document

Please click the download button to view the document.

Details

Journal Title:

Frontiers in Marine Science
Personal Author:

Zhang, Zhiyong ; Kaveti, Pushyami ; Singh, Hanumant ; Powell, Abigail ; Fruh, Erica ; Clarke, M. Elizabeth
NOAA Program & Office:

NWFSC (Northwest Fisheries Science Center) ; NMFS (National Marine Fisheries Service)
Description:

This paper presents a labeling methodology for marine life data using a weakly supervised learning framework. The methodology iteratively trains a deep learning model using non-expert labels obtained from crowdsourcing. This approach enables us to converge on a labeled image dataset through multiple training and production loops that leverage crowdsourcing interfaces. We present our algorithm and its results on two separate sets of image data collected using the Seabed autonomous underwater vehicle. The first dataset consists of 10,505 images that were point annotated by NOAA biologists. This dataset allows us to validate the accuracy of our labeling process. We also apply our algorithm and methodology to a second dataset consisting of 3,968 completely unlabeled images. These image categories are challenging to label, such as sponges. Qualitatively, our results indicate that training with a tiny subset and iterating on those results allows us to converge to a large, highly annotated dataset with a small number of iterations. To demonstrate the effectiveness of our methodology quantitatively, we tabulate the mean average precision (mAP) of the model as the number of iterations increases.
Keywords:

Aquatic Science Global And Planetary Change Ocean Engineering Oceanography Water Science And Technology Global And Planetary Change Water Science And Technology Global And Planetary Change Water Science And Technology
Source:

Frontiers in Marine Science, 10
DOI:

https://doi.org/10.3389/fmars.2023.1094190
ISSN:

2296-7745
Format:

PDF
Publisher:

Frontiers Media SA
Document Type:

Journal Article
License:

https://creativecommons.org/licenses/by/4.0/
Rights Information:

CC BY
Compliance:

Library
Main Document Checksum:

urn:sha-512:8cee156484139c649a8a7ab293cf3969c5d8f1901e84f9ca1a9a00f5fcc8853064917d2029e0841a02f41ef4ea435d862fe996519193aa10a91fa6f71a2290a6
Download URL:

https://repository.library.noaa.gov/view/noaa/63389/noaa_63389_DS1.pdf
File Type:

[PDF - 8.75 MB ]

ON THIS PAGE

Details

The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles, guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners. As a repository, the NOAA IR retains documents in their original published format to ensure public access to scientific information.