Application of Convolutional Neural Networks in the Problem of Removing Shadows from Photographs

38

Abstract

The article proposes a method for removing shadows from photographs using deep learning methods. The proposed method consists of several stages: dividing the image into rectangular fragments of 32x32 pixels, localizing shadows on each fragment, restoring the color of shadowed objects, and combining the fragments back into a whole image. Shadow localization is considered as a semantic segmentation problem; to solve it, a neural network of encoder-decoder architecture has been developed and trained. To restore the color of objects in identified shaded areas, another neural network based on the CDNet architecture is used. Examples of image processing using the developed method are given, including images from a drone, and the high quality of restoration of shaded areas is demonstrated.

General Information

Keywords: computer vision, deep learning, image processing, convolutional neural networks, shadow localization, semantic segmentation

Journal rubric: Data Analysis

Article type: scientific article

DOI: https://doi.org/10.17759/mda.2024140103

Received: 27.02.2024

Accepted:

For citation: Alekseychuk A.S., Mukin Yu.D. Application of Convolutional Neural Networks in the Problem of Removing Shadows from Photographs. Modelirovanie i analiz dannikh = Modelling and Data Analysis, 2024. Vol. 14, no. 1, pp. 41–51. DOI: 10.17759/mda.2024140103. (In Russ., аbstr. in Engl.)

References

  1. Zhang X., Zhao Y., Gu C., Lu C., Zhu S. SpA-Former: An Effective and lightweight Transformer for image shadow removal // International Joint Conference on Neural Networks (IJCNN). P. 1-8.
  2. Simonyan K., Zisserman A. Very Deep Convolutional Networks for Large-Scale Image Recognition // 3rd International Conference on Learning Representations, ICLR 2015, San Diego, CA, USA. 2015. Conference Track Proceedings.
  3. Soria X., Sappa A., Hammoud R. Wide-Band Color Imagery Restoration for RGB-NIR Single Sensor Images // Sensors (Basel, Switzerland). Vol.18. №7. P. 2059.
  4. Kuzmin С. А. Ustranenie vliyaniya tenej na tochnost vydeleniya obyektov v videoposledovatelnostyah [Eliminating the influence of shadows on the accuracy of object selection in video sequences] // Zhurnal Radioelektroniki=Radioelectronics Journal [Online journal]. №5. 2012. Available at: jre.cplire.ru/jre/may12/2/text.html (Accessed 01.02.2024). (In Russ.).

Information About the Authors

Andrey S. Alekseychuk, PhD in Physics and Matematics, Associate Professor, Moscow Aviation Institute (National Research University), Associate Professor of the Department of Digital Education, Moscow State University of Psychology and education, Moscow, Russia, ORCID: https://orcid.org/0000-0003-4167-8347, e-mail: alexejchuk@gmail.com

Yuriy D. Mukin, student, Moscow Aviation Institute (National Research University), Moscow, Russia, ORCID: https://orcid.org/0009-0003-6804-2039, e-mail: yurimukind@gmail.com

Metrics

Views

Total: 59
Previous month: 7
Current month: 3

Downloads

Total: 38
Previous month: 4
Current month: 0