DuPLO: A DUal view Point deep Learning architecture for time series classificatiOn

Abstract : Nowadays, modern Earth Observation systems continuously generate huge amounts of data. A notable example is represented by the Sentinel-2 mission, which provides images at high spatial resolution (up to 10m) with high temporal revisit period (every 5 days), which can be organized in Satellite Image Time Series (SITS). While the use of SITS has been proved to be beneficial in the context of Land Use/Land Cover (LULC) map generation, unfortunately, machine learning approaches commonly leveraged in remote sensing field fail to take advantage of spatio-temporal dependencies present in such data. Recently, new generation deep learning methods allowed to significantly advance research in this field. These approaches have generally focused on a single type of neural network, i.e., Convolutional Neural Networks (CNNs) or Recurrent Neural Networks (RNNs), which model different but complementary information: spatial autocorrelation (CNNs) and temporal dependencies (RNNs). In this work, we propose the first deep learning architecture for the analysis of SITS data, namely \method{} (DUal view Point deep Learning architecture for time series classificatiOn), that combines Convolutional and Recurrent neural networks to exploit their complementarity. Our hypothesis is that, since CNNs and RNNs capture different aspects of the data, a combination of both models would produce a more diverse and complete representation of the information for the underlying land cover classification task. Experiments carried out on two study sites characterized by different land cover characteristics (i.e., the \textit{Gard} site in France and the \textit{Reunion Island} in the Indian Ocean), demonstrate the significance of our proposal.
Document type :
Journal articles
Complete list of metadatas

Cited literature [20 references]  Display  Hide  Download

https://hal-lirmm.ccsd.cnrs.fr/lirmm-02011262
Contributor : Isabelle Gouat <>
Submitted on : Wednesday, March 20, 2019 - 10:52:36 AM
Last modification on : Wednesday, September 18, 2019 - 4:04:05 PM
Long-term archiving on : Friday, June 21, 2019 - 1:35:30 PM

File

1809.07589.pdf
Files produced by the author(s)

Identifiers

Citation

Roberto Interdonato, Dino Ienco, Raffaele Gaetano, Kenji Ose. DuPLO: A DUal view Point deep Learning architecture for time series classificatiOn. ISPRS Journal of Photogrammetry and Remote Sensing, Elsevier, 2019, 149, pp.91-104. ⟨10.1016/j.isprsjprs.2019.01.011⟩. ⟨lirmm-02011262⟩

Share

Metrics

Record views

145

Files downloads

130