Performance Analysis of Feature based Multiple Descriptors with Histogram Equalization for Image Mosaicing

H Shridhar; Sunil S Harakannanavar; Vidyashree Kanabur; H Jayalaxmi

doi:10.17485/IJST/v16i31.433

Article

Performance Analysis of Feature based Multiple Descriptors with Histogram Equalization for Image Mosaicing

VIEWS 396
PDF 94

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v16i31.433

Year: 2023, Volume: 16, Issue: 31, Pages: 2380-2387

Original Article

Performance Analysis of Feature based Multiple Descriptors with Histogram Equalization for Image Mosaicing

H Shridhar^1*, Sunil S Harakannanavar², Vidyashree Kanabur³, H Jayalaxmi⁴

¹Department of Electronics and Communication Engineering, Government Engineering College, Haveri, 581110, Karnataka, India
²Department of Electronics and Communication Engineering, Nitte Meenakshi Institute of Technology, Yelahanka, Bangalore, 560064, Karnataka, India
³Department of Electronics and Communication Engineering, National Institute of Technology, Surathkal, Mangalore, 575025, Karnataka, India
⁴Department of Electronics and Communication Engineering, Acharya Institute of Technology, Bangalore, 560107, Karnataka, India

*Corresponding Author
Email: [email protected]

Received Date:22 June 2023, Accepted Date:09 July 2023, Published Date:14 August 2023

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objectives: The main objective of the proposed work is to develop an image mosaicing model for combining the images of different individual images. In other way, the union of two images and to evaluate the performance of the model in terms of the number of run time in seconds and number of key features they use. Methods: In this work, the Histogram Equalization is a processing step required to make the mosaic invariant to intra image and inter image intensity variability. The detailed feature of the enhanced image is extracted using Scale-invariant feature transform (SIFT), Oriented Fast and Rotated Brief (ORB), Binary Robust invariant scalable key points (BRISK) feature descriptors techniques. The features including local and global are matched using K-Nearest Neighbor. Then, homography is performed using RANdom SAmple Consensus (RANSAC) algorithm to compute the camera motion. Finally, the image warping is performed using smoothing filter of size 40x40 to obtain the panorama image. Findings: The model is tested on various datasets using three different feature extractors popularly used in image mosaicing or image stitching algorithms SIFT, ORB and BRISK descriptors. It is observed that the ORB is the best feature extractor among the state-of-the-art feature extractors. The ORB with HE uses a minimum of 500 key features to match the images and generates panoramic images that are invariant to shift and rotation with the minimum run time of 0.0836 seconds. Novelty: The state-of-the-art models developed by the researchers suffer with good number of matching points of the input images to generate the image mosaicing. This issue is addressed in the proposed model using multiple descriptors SIFT, ORB and BRISK techniques. The ORB with HE will provide the minimum key features and enough good matches of features with the record of minimum runtime to obtain the panoramic images.

Keywords: Mosaicing; Smoothing Filter; Histogram Equalization; Homography; Panorama Images

References

Lima AARD, Cabrera-Ponce J, Martinez-Carranza. Parallel Hashing-Based Matching for Real-Time Aerial Image Mosaicing. Real Time Image Processing. 2021;18:143–156. Available from: https://doi.org/10.1007/s11554-020-00959-y
Vishwakarma AK, Bhuyan MK. Image mosaicking using improved auto-sorting algorithm and local difference-based harris features. Multimedia Tools and Applications. 2020;79(31):23599–23616. Available from: https://doi.org/10.1007/s11042-020-09124-w
Liu H, Lv M, Gao Y, Li J, Lan J, Gao W. Information Processing System Design for Multi-rotor UAV-Based Earthquake Rescue. Man-Machine-Environment System Engineering. 2020;645:321–330. Available from: https://doi.org/10.1007/978-981-15-6978-4_39
Ismail H, Rahmani A, Aljasmi N, Quadir J. Stitching Approach for PV Panel Detection. 2020. Available from: https://doi.org/10.1109/ASET48392.2020.9118386
Lan X, Guo B, Huang Z, Zhang S. An Improved UAV Aerial Image Mosaic Algorithm Based on GMS-RANSAC. 2020 IEEE 5th International Conference on Signal and Image Processing (ICSIP). 2020;p. 148–152. Available from: https://doi.org/10.1109/ICSIP49896.2020.9339283
Lenjani A, Yeum CM, Dyke S, Bilionis I. Automated building image extraction from 360° panoramas for postdisaster evaluation. Computer-Aided Civil and Infrastructure Engineering. 2020;35(3):241–257. Available from: https://doi.org/10.1111/mice.12493
Zhang F, Yang T, Liu L, Liang B, Bai Y, Li J. Image-Only Real-Time Incremental UAV Image Mosaic for Multi-Strip Flight. IEEE Transactions on Multimedia. 2021;23:1410–1425. Available from: https://doi.org/10.1109/TMM.2020.2997193
Pan J, Chen L, Zhang L. A Multi-Image Mosaic Method for Farmland UAV Aerial Images via Reference Image Optimization. 2021 International Symposium on Computer Technology and Information Science (ISCTIS). 2021;p. 411–417. Available from: https://doi.org/10.1109/ISCTIS51085.2021.00089
Lungisani BA, Lebekwe CK, Zungeru AM. SIFT and RANSAC-Based Image Mosaic Algorithm for Image Compression. 2022 International Conference on Smart Applications, Communications and Networking (SmartNets). 2022;p. 1–5. Available from: https://doi.org/10.1109/SmartNets55823.2022.9994026
Qian L, Li H, Xu M. Image Mosaic algorithm based on improved AKAZE. 2022 3rd International Conference on Computer Vision, Image and Deep Learning & International Conference on Computer Engineering and Applications (CVIDL & ICCEA). 2022;p. 1089–1093. Available from: https://doi.org/10.1109/CVIDLICCEA56201.2022.9824924
Bai X. Overview of image mosaic technology by computer vision and digital image processing. 2021 IEEE International Conference on Data Science and Computer Application (ICDSCA). 2021;p. 569–572. Available from: https://doi.org/10.1109/ICDSCA53499.2021.9650329
Tong C, Jianfeng G, Xueli X, Jianxiang X. High-precision Image Mosaic Algorithm Based on Adaptive Homography Transform. 2021 40th Chinese Control Conference (CCC). 2021;p. 3030–3035. Available from: https://doi.org/10.23919/CCC52363.2021.9549380
Li H, Wang J, Han C. Image Mosaic and Hybrid Fusion Algorithm Based on Pyramid Decomposition. 2020 International Conference on Virtual Reality and Visualization (ICVRV). 2020;p. 205–208. Available from: https://doi.org/10.1109/ICVRV51359.2020.00049
Tian F, Zhou Y, Cheng J, Feng Z, Yu J, Ye G, et al. GPU-based Real-time Image Mosaicing for UAVs. 2022 8th Annual International Conference on Network and Information Systems for Computers (ICNISC). 2022;p. 144–149. Available from: https://doi.org/10.1109/ICNISC57059.2022.00039
Yan K, Han M. Aerial Image Stitching Algorithm Based on Improved GMS. 2018 Eighth International Conference on Information Science and Technology (ICIST). 2018;p. 351–357. Available from: https://doi.org/10.1109/ICIST.2018.8426189
Liu G, Chen J, Zheng Y. A document stitching method based on optimal seam. 2016 9th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI). 2016;p. 162–166. Available from: https://doi.org/10.1109/CISP-BMEI.2016.7852701
Bindu H, Sowmya L, Sravyareddy M, Vedasai VS, Rachana P, Tejaswini. Image Mosaicing Using Feature Detection with Surf Technique. International Journal of Engineering Research and Advanced Development. 2018;4(5):1–5. Available from: https://www.researchgate.net/publication/326008719_Image_Mosaicing_Using_Feature_Detection_with_Surf_Technique
Jayalaxmi H, Ramachandran S. Performance analysis on color image mosaicing techniques on FPGA. International Journal of Electrical and Computer Engineering. 2019;9(3):1630–1636. Available from: http://doi.org/10.11591/ijece.v9i3.pp1630-1636
Alex B, Caspar K, Lebekwe A, Murtala Z, Yahya A. The current state on usage of image mosaic algorithms. Elsevier Scientific African. 2022. Available from: https://doi.org/10.1016/j.sciaf.2022.e01419

Copyright

© 2023 Shridhar et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)