Journal: IPSI Transactions on Internet Research


Detecting and Removing Clouds Affected Regions
From Satellite Images Using Deep Learning

Authors: Egharevba, Lawrence Kumar, Sanjoy Amini, Hadi
Adjouadi, Malek and Rishe, Naphtali


View PDF Cite this article

Abstract

Deep Learning is becoming a very popular tool for generating and reconstructing images. Research has shown that deep learning algorithms can perform cutting-edge restoration tasks for various types of images. The performance of these algorithms can be achieved by training Deep Convolutional Neural Networks (DCNNs) with data from a large sample size. The processing of high-resolution satellite imagery becomes difficult when there are only a few images in a dataset. Approaches based on the intrinsic properties of Deep Convolutional Neural Networks (DCNNs) are discussed in this paper for the detection and removal of clouds from remote sensing images without any prior training. Specifically, we focus on reviewing the 2022 study by Czerkawski et al. [10] that proposed deep internal learning for the inpainting of cloud-affected regions in satellite imagery. The technique analyzed performed well when compared to trained algorithms. We also provide an overview of some future research directions.


Keywords

Artificial Intelligence, Cloud Detection and Removal, Deep Learning, Image Reconstruction, Remote Sensing


Published in: IPSI Transaction on Internet Research (Volume: 19, Issue: 2)
Publisher: IPSI, Belgrade

Date of Publication: July 1, 2023

Open Access: CC-BY-NC-ND
DOI: 10.58245/ipsi.tir.2302.03

Pages: 13 - 23

ISSN: 1820 - 4503



References

1. Burger, H. C., Schuler, C. J., & Harmeling, S. (2012, June). Image denoising: Can plain neural networks compete with BM3D? In 2012 IEEE conference on computer vision and pattern recognition (pp. 2392-2399). IEEE.

2. Li, J., Hu, Q., & Ai, M. (2018). Haze and thin cloud removal via sphere model improved dark channel prior. IEEE Geoscience and Remote Sensing Letters, 16(3), 472- 476.

3. Shen, H., Li, X., Cheng, Q., Zeng, C., Yang, G., Li, H., & Zhang, L. (2015). Missing information reconstruction of remote sensing data: A technical review. IEEE Geoscience and Remote Sensing Magazine, 3(3), 61-85.

4. Zhang, Q., Yuan, Q., Zeng, C., Li, X., & Wei, Y. (2018). Missing data reconstruction in remote sensing image with a unified spatial–temporal–spectral deep convolutional neural network. IEEE Transactions on Geoscience and Remote Sensing, 56(8), 4274-4288.

5. Jeppesen, J. H., Jacobsen, R. H., Inceoglu, F., & Toftegaard, T. S. (2019). A cloud detection algorithm for satellite imagery based on deep Learning. Remote sensing of environment, 229, 247-259.

6. Enomoto, K., Sakurada, K., Wang, W., Fukui, H., Matsuoka, M., Nakamura, R., & Kawaguchi, N. (2017). Filmy cloud removal on satellite imagery with multispectral conditional generative adversarial nets. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 48-56).

7. Drusch, M., Del Bello, U., Carlier, S., Colin, O., Fernandez, V., Gascon, F., ... & Bargellini, P. (2012). Sentinel-2: ESA's optical high-resolution mission for GMES operational services. Remote sensing of Environment, 120, 25-36.

8. Meraner, A., Ebel, P., Zhu, X. X., & Schmitt, M. (2020). Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion. ISPRS Journal of Photogrammetry and Remote Sensing, 166, 333-346.

9. Wang, Z., Bovik, A. C., Sheikh, H. R., & Simoncelli, E. P. (2004). Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4), 600-612.

10. Upadhyay, P., Czerkawski, M., Davison, C., Cardona, J., Macdonald, M., Andonovic, I., ... & Tachtatzis, C. (2022). A flexible multi-temporal and multi-modal framework for Sentinel-1 and Sentinel-2 analysis ready data. Remote Sensing, 14(5), 1120.

...

×

Egharevba, Lawrence

School of Computing and Information Sciences, Florida Internation University, USA.
e-mail: legha001@fiu.edu; Orcid ID: 0000-0003-0298-2506

×

Kumar, Sanjoy

School of Computing and Information Sciences, Florida Internation University, USA.
e-mail: sanjoy.eee32@gmail.com;

× Amini, Hadi

Department Electrical and Computer Engineering, Florida Internation University, USA.
e-mail: amini@cs.fiu.edu

× Adjouadi, Malek

Department Electrical and Computer Engineering, Florida Internation University, USA.
e-mail: adjouadi@fiu.edu

×

Rishe, Naphtali

School of Computing and Information Sciences, Florida Internation University, USA.
e-mail: rishen@cs.fiu.edu; Orcid ID: 0000-0002-1611-4067

×

Cite this article

Egharevba, Lawrence; Kumar, Sanjoy; Amini, Hadi; Adjouadi, Malek; and Rishe, Naphtali "Detecting and Removing Clouds Affected Regions from Satellite Images Using Deep Learning", IPSI Transactions on Internet Research, vol. 19(2), pp. 13-23, 2023. https://doi.org/10.58245/ipsi.tir.2302.03