Siamese Neural Networks for Kinship Prediction: A Deep Convolutional Neural Network Approach

Tukaram Navghare; Aniket Muley; Vinayak Jadhav

doi:10.17485/IJST/v17i4.3018

Article

Siamese Neural Networks for Kinship Prediction: A Deep Convolutional Neural Network Approach

VIEWS 232
PDF 62

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v17i4.3018

Year: 2024, Volume: 17, Issue: 4, Pages: 352-358

Original Article

Siamese Neural Networks for Kinship Prediction: A Deep Convolutional Neural Network Approach

Tukaram Navghare^1*, Aniket Muley¹, Vinayak Jadhav²

¹School of Mathematical Sciences, Swami Ramanand Teerth Marathwada University, Nanded, 431606, Maharashtra, India
²Shivaji College, Udgir, 413517, Maharashtra, India

*Corresponding Author
Email: [email protected]

Received Date:26 November 2023, Accepted Date:28 December 2023, Published Date:20 January 2024

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objective: This study worked out kinship verification, which is a laborious problem in scientific discipline and pattern discovery. It has many applications, such as: finding missing children, identify family and non family member. The aim is to kinship prediction using similarity computation to identify kin and non-kin based on image dataset. Method: To measure the similarity score of the proposed method on primary 96-family dataset, considers 410 images and 77,887 different pairs. The data was split into 80% for training and 20% for testing. This study proposed Siamese Deep Convolutional Neural Network model with deep algorithm viz., ResNet and VGGNet with Adam optimizer to verify the kinship for the four kinship relations of father-son, father-daughter, mother-son and mother-daughter. Findings: It is observed that, the proposed model gives better perform and with 72.73% average similarity score. Novelty: Experimental results on the primary kinship datasets showed the superior performance of the proposed methods over state-of-the-art kinship verification methods and human ability in our kinship verification task. In the future, this model can be applicable for kinship verification in society.

Keywords: Deep learning, Imagebased kinship verification, Convolutional Neural Network, Siamese Neural Network, Adam, ResNet, VGGNet

References

Tiong LCO, Kim ST, Ro YM. Multimodal facial biometrics recognition: Dual-stream convolutional neural networks with multi-feature fusion layers. Image and Vision Computing. 2020;102:103977. Available from: https://doi.org/10.1016/j.imavis.2020.103977
Robinson JP, Shao M, Wu Y, Liu H, Gillis T, Fu Y. Visual Kinship Recognition of Families in the Wild. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2018;40(11):2624–2637. Available from: https://doi.org/10.1109/TPAMI.2018.2826549
Wang S, Ding Z, Fu Y. Cross-generation kinship verification with sparse discriminative metric. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2019;41(11):2783–2790. Available from: https://doi.org/10.1109/TPAMI.2018.2861871
Liang J, Hu Q, Dang C, Zuo W. Weighted Graph Embedding-Based Metric Learning for Kinship Verification. IEEE Transactions on Image Processing. 2019;28(3):1149–1162. Available from: https://doi.org/10.1109/TIP.2018.2875346
Dong GNN, Pun CMM, Zhang Z. Deep Collaborative Multi-Modal Learning for Unsupervised Kinship Estimation. IEEE Transactions on Information Forensics and Security. 2021;16:4197–4210. Available from: https://doi.org/10.1109/TIFS.2021.3098165
Bisogni C, Narducci F. Kinship recognition: how far are we from viable solutions in smart environments? Procedia Computer Science. 2022;198:225–230. Available from: https://doi.org/10.1016/j.procs.2021.12.232
Chergui A, Ouchtati S, Mavromatis S, Bekhouche SE, Lashab M, Sequeira J. Kinship Verification Through Facial Images Using CNN-Based Features. Traitement du Signal. 2020;37(1):1–8. Available from: https://doi.org/10.18280/ts.370101
Zhang H, Wang X, Kuo CCJ. Deep Kinship Verification VIA Appearance-Shape Joint Prediction and Adaptation-Based Approach. In: 2019 IEEE International Conference on Image Processing (ICIP). IEEE. 2019.
Wei Z, Xu M, Geng L, Liu H, Yin H. Adversarial Similarity Metric Learning for Kinship Verification. IEEE Access. 2019;7:100029–100035. Available from: https://doi.org/10.1109/ACCESS.2019.2929939
Goyal A, Meenpal T, Mukherjee M. Family classification and kinship verification from facial images in the wild. Machine Vision and Applications. 2022;33(6). Available from: https://doi.org/10.1007/s00138-022-01341-7
Hayale W, Negi PS, Mahoor MH. Deep Siamese Neural Networks for Facial Expression Recognition in the Wild. IEEE Transactions on Affective Computing. 2023;14(2):1148–1158. Available from: https://doi.org/10.1109/TAFFC.2021.3077248
Ramazankhani F, Yazdian-Dehkord M, Rezaeian M. Feature Fusion and NRML Metric Learning for Facial Kinship Verification. JUCS - Journal of Universal Computer Science. 2023;29(4):326–348. Available from: https://lib.jucs.org/article/89254/
Rachmadi RF, Purnama IK, Nugroho SM, Suprapto YK. Image-based Kinship Verification using Fusion Convolutional Neural Network. In: 2019 IEEE 11th International Workshop on Computational Intelligence and Applications (IWCIA). Hiroshima, Japan, 09-10 November 2019. IEEE. .
Rachmadi RF, Purnama IKE, Nugroho SMS, Suprapto YK. Family-Aware Convolutional Neural Network for Image-based Kinship Verification. International Journal of Intelligent Engineering and Systems. 2020;13(6):20–30. Available from: https://www.inass.org/2020/2020123103.pdf
Rehman A, Khalid Z, Fawad, Asghar MA, Khan MJ. Kinship verification using Deep Neural Network Models. In: 2019 International Symposium on Recent Advances in Electrical Engineering (RAEE). (Vol. 4, pp. 1-6) IEEE. 2019.
Chergui A, Ouchtati S, Mavromatis S, Bekhouche SE, Sequeira J, Dornaika F. Kinship verification through facial images using multiscale and multilevel handcrafted features. Journal of Electronic Imaging. 2020;29(02):023017-1–023017-23. Available from: https://doi.org/10.1117/1.JEI.29.2.023017
Ozkan S, Ozkan A. Kinshipgan: Synthesizing of Kinship Faces from Family Photos by Regularizing a Deep Face Network. In: 2018 25th IEEE International Conference on Image Processing (ICIP). IEEE. 2018.
Yu J, Xie G, Hao X, Cui Z, Zhang L, Cai Z. Deep Kinship Verification and Retrieval Based on Fusion Siamese Neural Network. In: 2021 16th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2021). (Vol. 2021, pp. 1-8) IEEE. 2022.
Ilina O, Ziyadinov V, Klenov N, Tereshonok M. A Survey on Symmetrical Neural Network Architectures and Applications. Symmetry. 2022;14(7):1–32. Available from: https://doi.org/10.3390/sym14071391

Copyright

© 2024 Navghare et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)