A Deep learning method for accurate and fast identification of coral reef fishes in underwater images

Sebastien Villon 1, 2 David Mouillot 1 Marc Chaumont 2, 3 Emily Darling 4 Gérard Subsol 2 Thomas Claverie 1 Sébastien Villéger 1
1 UMR MARBEC - MARine Biodiversity Exploitation and Conservation
2 ICAR - Image & Interaction
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier
3 UNIMES - Université de Nîmes
4 LabEX CORAIL - Laboratoire d'Excellence CORAIL
Abstract : Identifying and counting fish individuals on photos and videos is a crucial task to cost-effectively monitor marine biodiversity, yet it remains difficult and time-consuming. In this paper, we present a method to assist the identification of fish species on underwater images, and we compare our model performances to human ability in terms of speed and accuracy. We first tested the performance of a convolutional neural network (CNN) trained with different photographic databases while accounting for different post-processing decision rules to identify 20 fish species. Finally, we compared the performance of species identification of our best CNN model with that of humans on a test database of 1197 fish images representing nine species. The best CNN was the one trained with 900 000 images including (i) whole fish bodies, (ii) partial fish bodies and (iii) the environment (e.g. reef bottom or water). The rate of correct identification was 94.9%, greater than the rate of correct identification by humans (89.3%). The CNN was also able to identify fish individuals partially hidden behind corals or behind other fish and was more effective than humans to identify fish on smallest or blurry images while humans were better to identify fish individuals in unusual positions (e.g. twisted body). On average, each identification by our best CNN using a common hardware took 0.06 seconds. Deep Learning methods can thus perform efficient fish identification on underwater images and offer promises to build-up new video-based protocols for monitoring fish biodiversity cheaply and effectively.
Keywords : Automated identification Machine learning Marine fishes Convolutional neural network Underwater images
Document type :
Journal articles
Complete list of metadatas
https://hal-lirmm.ccsd.cnrs.fr/lirmm-01884005
Contributor : Marc Chaumont <>
Submitted on : Saturday, September 29, 2018 - 12:48:36 PM
Last modification on : Saturday, April 20, 2019 - 1:53:41 AM
Long-term archiving on : Monday, December 31, 2018 - 10:02:14 AM

File

Elsevier-Ecological-Informatic...
Files produced by the author(s)

Identifiers

Collections

LIRMM | UNIMES | EHESS | EPHE | UNIV-AG | ICARLIRMM | PSL | IRD | MIPS | UNIV-MONTPELLIER | UPF | B3ESTE

Citation

Sebastien Villon, David Mouillot, Marc Chaumont, Emily Darling, Gérard Subsol, et al.. A Deep learning method for accurate and fast identification of coral reef fishes in underwater images. Ecological Informatics, Elsevier, 2018, 48, pp.238-244. ⟨10.1016/j.ecoinf.2018.09.007⟩. ⟨lirmm-01884005⟩

Export

BibTeX TEI DC DCterms EndNote

Share

Metrics

Record views

363

Files downloads

566

Contact

support.ccsd.cnrs.fr
hal.support@ccsd.cnrs.fr
Logo CCSD