Orthophotomosaicing Framework for Thermal and Multispectral Images Collected with a UAV for Intelligent Systems
DOI:
https://doi.org/10.18372/1990-5548.84.20189Keywords:
machine learning, orthophotomosaicing, image processing, unmanned aerial vehicles, mine detectionAbstract
In this paper, a framework for orthophotomosaicing of multispectral and thermal images collected by unmanned aerial vehicles is presented. The proposed framework is based on a two-stage data preprocessing and mosaicing orthophotographic restoration of images captured with a route-planned unmanned aerial vehicle collection. The super-resolution and image restoration step is handled via a two-pathway U-net image restoration artificial neural network. The framework simplifies the process and makes the collected data less sensitive to noise via image restoration and upscaling steps. The framework was tested on visible, multispectral and thermal images and provides 3.5% and 5.34% improvements in peak signal-to-noise ratio for multispectral and thermal orthophotomosaics.
References
P. Bergmans, “A simple converse for broadcast channels with additive white gaussian noise (corresp.),” IEEE Trans. on Information Theory, 1974, vol. 20, no. 2, pp. 279-280. https://doi.org/10.1109/TIT.1974.1055184
Wong, Chi Man, et al. "Spatial filtering in SSVEP-based BCIs: Unified framework and new improvements." IEEE Transactions on Biomedical Engineering 67.11 (2020): 3057-3072. https://doi.org/10.1109/TBME.2020.2975552
Roy, Vandana, and Shailja Shukla. "Spatial and transform domain filtering method for image de-noising: a review." International Journal of Modern Education and Computer Science 5.7 (2013): 41. https://doi.org/10.5815/ijmecs.2013.07.05
Buades, Antoni, Bartomeu Coll, and Jean-Michel Morel. "Non-local means denoising." Image Processing On Line 1 (2011): 208-212. https://doi.org/10.5201/ipol.2011.bcm_nlm
Liu, Zhe, Wei Qi Yan, and Mee Loong Yang. "Image denoising based on a CNN model." 2018 4th International conference on control, automation and robotics (ICCAR). IEEE, 2018. https://doi.org/10.1109/ICCAR.2018.8384706
Michailovich, Oleg, and Allen Tannenbaum. "Blind deconvolution of medical ultrasound images: A parametric inverse filtering approach." IEEE Transactions on Image Processing 16.12 (2007): 3005-3019. https://doi.org/10.1109/TIP.2007.910179
Robinson, Enders A., and Sven Treitel. "Principles of digital Wiener filtering." Geophysical Prospecting 15.3 (1967): 311-332. https://doi.org/10.1111/j.1365-2478.1967.tb01793.x
Ingaramo, Maria, et al. "Richardson–Lucy deconvolution as a general tool for combining images with complementary strengths." ChemPhysChem 15.4 (2014): 794-800. https://doi.org/10.1002/cphc.201300831
Real, Rommel, and Qinian Jin. "A revisit on Landweber iteration." Inverse problems 36.7 (2020): 075011. https://doi.org/10.1088/1361-6420/ab8bc4
Min, Chao, et al. "Blind deblurring via a novel recursive deep CNN improved by wavelet transform." IEEE Access 6 (2018): 69242-69252. https://doi.org/10.1109/ACCESS.2018.2880279
Lindeberg, Tony. "Scale invariant feature transform." (2012): 10491. https://doi.org/10.4249/scholarpedia.10491
Bay, Herbert, et al. "Speeded-up robust features (SURF)." Computer vision and image understanding 110.3 (2008): 346-359. https://doi.org/10.1016/j.cviu.2007.09.014
Peng, Zongyi, et al. "Seamless UAV hyperspectral image stitching using optimal seamline detection via graph cuts." IEEE Transactions on Geoscience and Remote Sensing 61 (2023): 1-13. https://doi.org/10.1109/TGRS.2023.3275970
Wyatt, Clair. Radiometric calibration: theory and methods. Elsevier, 2012.
Sineglazov, Viktor, Kyrylo Lesohorskyi, and Olena Chumachenko. "Faster Image Deblurring for Unmanned Aerial Vehicles." 2024 2nd International Conference on Unmanned Vehicle Systems-Oman (UVS). IEEE, 2024. https://doi.org/10.1109/UVS59630.2024.10467152
Glossner, John, Samantha Murphy, and Daniel Iancu. "An overview of the drone open-source ecosystem." arXiv preprint arXiv:2110.02260 (2021).
Downloads
Published
How to Cite
Issue
Section
License
The scientific journal “Electronics and control systems” adheres to the principles of Open Access and provides free, immediate, and permanent access to all published materials without financial, technical, or legal barriers for readers.
All articles are published in Open Access under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.
Copyright
Authors who publish their works in the journal “Electronics and control systems”:
-
retain the copyright to their publications;
-
grant the journal the right of first publication of the article;
-
agree to the distribution of their materials under the CC BY 4.0 license;
-
have the right to reuse, archive, and distribute their works (including in institutional and subject repositories), provided that proper reference is made to the original publication in the journal.




