• P-ISSN 0974-6846 E-ISSN 0974-5645

Indian Journal of Science and Technology


Indian Journal of Science and Technology

Year: 2024, Volume: 17, Issue: 7, Pages: 660-669

Original Article

Frequency and Spatial Domain-Based Approaches for Recognition of Indian Sign Language Gestures

Received Date:09 November 2023, Accepted Date:23 December 2023, Published Date:14 February 2024


Objectives: The objective of this paper is to introduce and demonstrate an innovative approach for the recognition of Indian sign language gestures, with a focus on bridging communication gap between the deaf and hearing communities. The goal is to contribute to the development of effective tools and technologies that facilitate seamless communication between individuals using sign language and the people with no knowledge about sign language. Methods: The methodology consists of three key steps. First, data pre-processing involves resizing and contours extraction. Next, feature extraction employs Fourier descriptors for frequency domain analysis and gray-level-co-occurrence matrix for spatial domain analysis. Finally, various machine learning models including SVM, Random Forest, Logistic Regression, K-Nearest Neighbor and Naive Bayes are trained on a standard dataset. Findings: In our controlled experimental setup, we applied a diverse set of machine learning classifiers to evaluate the proposed approach for gesture recognition. Among the classifiers tested, K-Nearest Neighbors demonstrated the highest accuracy, achieving 99.82%. To validate the robustness of our approach, we employed k-fold cross-validation with 5 folds. Novelty: This study presents an innovative method for sign language recognition by employing a dual-domain fusion strategy that prominently emphasizes the frequency domain. Through the integration of Fourier descriptors, the research conducts a detailed frequency domain analysis to characterize the contour shapes of sign language gestures. The synergy with gray-level co-occurrence matrix texture features in the spatial domain analysis, contributes to the creation of a comprehensive feature vector. The proposed approach ensures a thorough exploration of gesture features, there by advancing the precision and efficacy of sign language recognition.

Keywords: Indian Sign Language (ISL), Sign Language Recognition (SLR), Frequency domain, Spatial domain, Fourier descriptors, Gray level co­occurrence matrix (GLCM), K­ Fold


  1. Indra D, Purnawansyah, Madenda SP, Wibowo EP. Indonesian Sign Language Recognition Based on Shape of Hand Gesture. Procedia Computer Science. 2019;161:74–81. Available from: https://doi.org/10.1016/j.procs.2019.11.101
  2. Yang C, Yu Q. Multiscale Fourier descriptor based on triangular features for shape retrieval. Signal Processing: Image Communication. 2019;71:110–119. Available from: https://doi.org/10.1016/j.image.2018.11.004
  3. Tharwat G, Ahmed AM, Bouallegue B. Arabic Sign Language Recognition System for Alphabets Using Machine Learning Techniques. Journal of Electrical and Computer Engineering. 2021;2021:1–17. Available from: https://doi.org/10.1155/2021/2995851
  4. Liu J, Yuan J, Cui J, Liu Y, Liu X. Contour Resampling-Based Garlic Clove Bud Orientation Recognition for High-Speed Precision Seeding. Agriculture. 2022;12(9):1–26. Available from: https://doi.org/10.3390/agriculture12091334
  5. Erwin, Karo NNB, Sari AY, Aziza N, Putra HK. The Enhancement of Fingerprint Images using Gabor Filter. In: International Conference on Information System, Computer Science and Engineering, Journal of Physics: Conference Series. (Vol. 1196, pp. 012045) IOP Publishing. 2019.
  6. Indian Sign Language Recognition Using Canny Edge Detection. International Journal of Advanced Trends in Computer Science and Engineering. 2021;10(3):1576–1583. Available from: https://doi.org/10.30534/ijatcse/2021/131032021
  7. Shravani K, Lakshmi AS, Geethika MS, Kulkarni SB. Indian Sign Language Character Recognition. IOSR Journal of Computer Engineering (IOSR-JCE). 2020;22(3):14–19. Available from: https://www.iosrjournals.org/iosr-jce/papers/Vol22-issue3/Series-1/B2203011419.pdf


© 2024 Poornima & Srinath. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)


Subscribe now for latest articles and news.