Performance Evaluation of Fusion Based Efficient Algorithm for Facial Expression Recognition

Sunil S Harakannanavar; C Sapnakumari; A C Ramachandra; R Pramodhini; C R Prashanth

doi:10.17485/IJST/v16i4.1891

Article

Performance Evaluation of Fusion Based Efficient Algorithm for Facial Expression Recognition

VIEWS 503
PDF 86

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v16i4.1891

Year: 2023, Volume: 16, Issue: 4, Pages: 266-276

Original Article

Performance Evaluation of Fusion Based Efficient Algorithm for Facial Expression Recognition

Sunil S Harakannanavar1*, C Sapnakumari¹, A C Ramachandra¹, R Pramodhini¹, C R Prashanth²

¹Department of Electronics and Communication Engineering, Nitte Meenakshi Institute of
Technology, Yelahanka, Bangalore, Karnataka, India
²Department of Telecommunication Engineering, Dr. Ambedkar Institute of Technology, Mallathahalli, Bangalore, Karnataka, India

*Corresponding Author
Email: [email protected]

Received Date:19 September 2022, Accepted Date:15 December 2022, Published Date:28 January 2023

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objectives: To develop face expression recognition system using JAFFE database and to evaluate the performance of the face expression recognition models. Methods: This study used the FER model based on modified-HoG (Histogram of oriented gradient), LBP (Local Binary Patterns) and Fast Key point detector and BRIEF descriptor (FKBD) to extract the significant features of JAFFE dataset. The features extracted using HoG, LBP and FKBD techniques form a feature vector. Then, the fusion of all the features is carried out at the feature level. The multiclass SVM and KNN classifiers are used to recognize the facial expressions, effectively. Findings: In this work, an effort is made to develop a robust FER model using JAFFE database. It is recorded that, based on the experimental results, the proposed model suits better with a performance rate of 98.26% for SVM and 96.51% for KNN, when compared with the different state-of-the-art methods. Novelty: Many FER models have been developed and adopted for enhancing their quality and to extract the facial features using transform and frequency domains. It is observed that, maximum approaches are based on generating the texture features. The fusion at the feature level using modified HoG, LBP and FKBD is performed and the SVM model is more compatible when compared with other classifiers and it supports one-to-one and one-to-many comparisons’ technique.
Keywords: Face Expression Recognition; Local Binary Pattern; Emotions; Nearest Neighbor; Histogram of Gradients

References

Hyeon-Jung KS, Hong. A Study on Emotion Recognition Method and its Application using Face Image. IEEE Conference on Information and Communication Technology Convergence. 2017;p. 370–372. Available from: https://doi.org/10.1109/ICTC.2017.8191005
Kołodziej M, Majkowski A, Rak R, Tarnowski P, Pielaszkiewicz T. Analysis of facial features for the use of emotion recognition. IEEE International Conference of Computational Problems of Electrical Engineering. 2018;p. 1–4. Available from: https://doi.org/10.1109/CPEE.2018.8507137
Vibha V, Salunke CG, Patil. A New Approach for Automatic Face Emotion Recognition and Classification Based on Deep Networks. IEEE Conference on Computing, Communication, Control and Automation. 2018;p. 370–372. Available from: https://doi.org/10.1109/ICCUBEA.2017.8463785
Rastgoo R, Kiani K, Escalera S. Multi-Modal Deep Hand Sign Language Recognition in Still Images Using Restricted Boltzmann Machine. Entropy. 2018;20(11):809. Available from: https://doi.org/10.3390/e20110809
Ferreira C, R. On the role of multimodal learning in the recognition of sign language. International Journal of Multimedia Tools and Applications. 2019;7(8):10035–10056. Available from: https://doi.org/10.1007/s11042-018-6565-5
Keshari T, Palaniswamy S. Emotion Recognition Using Feature-level Fusion of Facial Expressions and Body Gestures. 2019 International Conference on Communication and Electronics Systems (ICCES). 2019;p. 1–5. Available from: https://doi.org/10.1109/ICCES45898.2019.9002175
Madupu RK, Madupu RK, Yarra V. Automatic Human Emotion Recognition System using Facial Expressions with Convolution Neural Network. IEEE International Conference of Electronics, Communication and Aerospace Technology. 2020;p. 1179–1183. Available from: https://doi.org/10.1109/ICECA49313.2020.9297483
Joesph C, Rajeswari A, Premalatha B, Balapriya C. Implementation of physiological signal based emotion recognition algorithm. 2020 IEEE 36th International Conference on Data Engineering (ICDE). 2020;p. 2075–2079. Available from: https://doi.org/10.1109/ICDE48307.2020.9153878
Hassouneh A, Mutawa AM, Murugappan M. Development of a Real-Time Emotion Recognition System Using Facial Expressions and EEG based on machine learning and deep neural network methods. Informatics in Medicine Unlocked. 2020;20(1):100372. Available from: https://doi.org/10.1016/j.imu.2020.100372
Sunil S, Harakannanavar, Prashanth C, Raja SRKB, Patil. Face Recognition based on SWT, DCT and LTP. Springer International Conference on Integrated Intelligent Computing, Communication and Security. 2019. Available from: https://doi.org/10.1007/978-981-10-8797-4_57
Robin MMH, Rahman AMU, Taief QM, Nahar. Improvement of Face and Eye Detection Performance by Using Multi-task Cascaded Convolutional Networks. IEEE region 10 Symposium. 2020;p. 977–980. Available from: https://doi.org/10.1109/TENSYMP50017.2020.9230756
Jaiswal A, Raju AK, Deb S. Facial Emotion Detection Using Deep Learning. 2020 International Conference for Emerging Technology (INCET). 2020;p. 1–5. Available from: https://doi.org/10.1109/INCET49848.2020.9154121
Nasri MA, Hmani MA, Mtibaa A, Petrovska-Delacretaz D, Slima MB, Hamida AB. Face Emotion Recognition From Static Image Based on Convolution Neural Networks. 2020 5th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP). 2020;p. 1–6. Available from: https://doi.org/10.1109/ATSIP49331.2020.9231537
Nguyen N. Global-local attention for emotion recognition. International Journal of Neural Computing & Applications. 2021(6):1–8. Available from: https://doi.org/10.1007/s00521-021-06778-x
2AMAA, Bilal KH. Review on Emotion Recognition Using Facial Expressions. European Journal of Electrical Engineering and Computer Science. 2021;(3) 1–4. Available from: https://doi.org/10.24018/ejece.2021.5.3.322
Pranav E, Kamal S, Chandran C, Supriya MH. Facial Emotion Recognition Using Deep Convolutional Neural Network. 2020. Available from: https://doi.org/10.1109/ICACCS48705.2020.9074302
Aguiñaga AR, Hernandez DE, Quezada A. Emotion Recognition by Correlating Facial Expressions and EEG Analysis. International Journal of Applied Science. 2021;(1) 1–10. Available from: https://doi.org/10.3390/app11156987
Costache A, Popescu D, Ichim L. Facial Expression Detection by Combining Deep Learning Neural Networks. 2021 12th International Symposium on Advanced Topics in Electrical Engineering (ATEE). 2021;p. 1–5. Available from: https://doi.org/10.1109/ATEE52255.2021.9425340
Sunil S, Harakannanavar, Prashanth CR, Raja KB. Performance Evaluation of Face Recognition based on the Fusion of Bit- Plane and Binary Image Compression Techniques using Euclidean Distance Classifier. International Journal of Intelligent Engineering and Systems. 2018;11(6):52–64. Available from: https://doi.org/10.22266/ijies2018.1231.06
Sun L, Dai J, Shen X. Facial emotion recognition based on LDA and Facial Landmark Detection. 2nd International Conference on Artificial Intelligence and Education (ICAIE). 2021;p. 64–67. Available from: https://doi.org/10.1109/ICAIE53562.2021.00020

Copyright

© 2023 Harakannanavar et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)