• P-ISSN 0974-6846 E-ISSN 0974-5645

Indian Journal of Science and Technology


Indian Journal of Science and Technology

Year: 2021, Volume: 14, Issue: 12, Pages: 971-983

Original Article

Facial expression recognition for low resolution images using convolutional neural networks and denoising techniques

Received Date:05 January 2021, Accepted Date:21 March 2021, Published Date:13 April 2021


Background/Objectives: There is only limited research work is going on in the field of facial expression recognition on low resolution images. Mostly, all the images in the real world will be in low resolution and might also contain noise, so this study is to design a novel convolutional neural network model (FERConvNet), which can perform better on low resolution images. Methods: We proposed a model and then compared with state-of-art models on FER2013 dataset. There is no publicly available dataset, which contains low resolution images for facial expression recognition (Anger, Sad, Disgust, Happy, Surprise, Neutral, Fear), so we created a Low Resolution Facial Expression (LRFE) dataset, which contains more than 6000 images of seven types of facial expressions. The existing FER2013 dataset and LRFE dataset were used. These datasets were divided in the ratio 80:20 for training and testing and validation purpose. A HDM is proposed, which is a combination of Gaussian Filter, Bilateral Filter and Non local means denoising Filter. This hybrid denoising method helps us to increase the performance of the convolutional neural network. The proposed model was then compared with VGG16 and VGG19 models. Findings: The experimental results show that the proposed FERConvNet_HDM approach is effective than VGG16 and VGG19 in facial expression recognition on both FER2013 and LRFE dataset. The proposed FERConvNet_HDM approach achieved 85% accuracy on Fer2013 dataset, outperforming the VGG16 and VGG19 models, whose accuracies are 60% and 53% on Fer2013 dataset respectively. The same FERConvNet_HDM approach when applied on LRFE dataset achieved 95% accuracy. After analyzing the results, our FERConvNet_HDM approach performs better than VGG16 and VGG19 on both Fer2013 and LRFE dataset. Novelty/Applications: HDM with convolutional neural networks, helps in increasing the performance of convolutional neural networks in Facial expression recognition.

Keywords: Facial expression recognition; facial emotion; convolutional neural network; deep learning; computer vision


  1. Deledalle CA, Duval V, Salmon J. Non-local Methods with Shape-Adaptive Patches (NLM-SAP) Journal of Mathematical Imaging and Vision. 2012;43(2):103–120. Available from: https://dx.doi.org/10.1007/s10851-011-0294-y
  2. Deng J, Pang G, Zhang Z, Pang Z, Yang H, Yang G. cGAN Based Facial Expression Recognition for Human-Robot Interaction. IEEE Access. 2019;7:9848–9859. Available from: https://dx.doi.org/10.1109/access.2019.2891668
  3. Zhang H, Jolfaei A, Alazab M. A Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing. IEEE Access. 2019;7:159081–159089. Available from: https://dx.doi.org/10.1109/access.2019.2949741
  4. Jian BL, Chen CL, Huang MW, Yau HT. Emotion-Specific Facial Activation Maps Based on Infrared Thermal Image Sequences. IEEE Access. 2019;7:48046–48052. Available from: https://dx.doi.org/10.1109/access.2019.2908819
  5. Pham TTD, Kim S, Lu Y, Jung SW, Won CS. Facial Action Units-Based Image Retrieval for Facial Expression Recognition. IEEE Access. 2019;7:5200–5207. Available from: https://dx.doi.org/10.1109/access.2018.2889852
  6. Lo L, Xie HX, Shuai HH, Cheng WH. MER-GCN: Micro-Expression Recognition Based on Relation Modeling with Graph Convolutional Networks. 2020 IEEE Conference on Multimedia Information Processing and Retrieval (MIPR). 2020. doi: 10.1109/mipr49039.2020.00023
  7. Ch S, Kiruthika K, Priya B, Jayalakshmi R, J. Detection ofHuman Facial Expression using CNN Model. International Journal of Engineering and Advanced Technology. 2020;9(5):2249–8958. doi: 10.35940/ijeat.E9615.069520
  8. Lu P, Song B, Xu L. Human face recognition based on convolutional neural network and augmented dataset. Systems Science & Control Engineering. 2020. Available from: https://dx.doi.org/10.1080/21642583.2020.1836526
  9. Kim JH, Kim BG, Roy PP, Jeong DM. Efficient Facial Expression Recognition Algorithm Based on Hierarchical Deep Neural Network Structure. IEEE Access. 2019;7:41273–41285. Available from: https://dx.doi.org/10.1109/access.2019.2907327
  10. Filntisis PP, Efthymiou N, Koutras P, Potamianos G, Maragos P. Gerasimos Potamianos, and Petros Maragos. “Fusing Body Posture With Facial Expressions for Joint Recognition of Affect in Child-Robot Interaction. IEEE Robotics and Automation Letters. 2019;4(4):4011–4018. doi: 10.1109/LRA.2019.2930434


© 2021 Bodavarapu & Srinivas. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)


Subscribe now for latest articles and news.