i
WaterGAN: Unsupervised Generative Network to Enable Real-time Color Correction of Monocular Underwater Images
-
2017
-
-
Source: IEEE Robotics and Automation Letters
Details:
-
Journal Title:IEEE Robotics and Automation Letters
-
Personal Author:
-
NOAA Program & Office:
-
Description:This paper reports on WaterGAN, a generativeadversarial network (GAN) for generating realistic underwaterimages from in-air image and depth pairings in an unsupervisedpipeline used for color correction of monocular underwaterimages. Cameras onboard autonomous and remotely operatedvehicles can capture high resolution images to map the seafloor;however, underwater image formation is subject to the complexprocess of light propagation through the water column. The rawimages retrieved are characteristically different than imagestaken in air due to effects such as absorption and scattering,which cause attenuation of light at different rates for differentwavelengths. While this physical process is well describedtheoretically, the model depends on many parameters intrinsicto the water column as well as the structure of the scene. Thesefactors make recovery of these parameters difficult withoutsimplifying assumptions or field calibration; hence, restorationof underwater images is a non-trivial problem. Deep learninghas demonstrated great success in modeling complex nonlinearsystems but requires a large amount of training data, which isdifficult to compile in deep sea environments. Using WaterGAN,we generate a large training dataset of corresponding depth,in-air color images, and realistic underwater images. This dataserves as input to a two-stage network for color correctionof monocular underwater images. Our proposed pipeline isvalidated with testing on real data collected from both a purewater test tank and from underwater surveys collected in thefield. Source code, sample datasets, and pretrained models aremade publicly available.
-
Keywords:
-
Source:IEEE Robotics and Automation Letters
-
DOI:
-
Document Type:
-
Funding:
-
Rights Information:Accepted Manuscript
-
Compliance:Submitted
-
Main Document Checksum:
-
Download URL:
-
File Type: