Total views : 112

Fusion in Multimodal Biometric System: A Review

Affiliations

  • Department of Computer Science and Engineering, I.K. Gujral Punjab Technical University, Kapurtala – 144603, Punjab, India
  • Department of CSE, Chandigarh Group of Colleges, Landran – 140307, Punjab, India
  • Department of CSE, Chandigarh College of Engineering and Technology, Chandigarh – 160019, India

Abstract


Objectives: The use of multimodal biometric has been introduced recently owing to use of multiple biometric modalities. Here we perform in-depth review of the various methods used for multimodal biometric technology. Methods/ Statistical Analysis: Here we present a systematic review of various methods used for fusing multiple biometric modalites. Specifically, fusing at various levels such as, before matching and after matching. Score level, feature level, rank level and decision fusion is followed by feature optimization using methods such as genetic algorithms and artificial neural networks. Findings: Single biometric based methods suffer from lack of security and efficiency. This leads to advent of multimodal biometric systems. However, fusing various biometric modalities is being persued with very high interest. We describe the granular nature of several methods used to fuse multiple biometric modalities. A wide range of methods are being employed to fuse biometric data. These methods vary in efficiency and are highly dependant upon the selection of type of biometric chosen for fusion. Application/Improvements: As computational efficiency increases, there increase in more secure and efficient biometric systems that use multiple sources of biometric identification and access authorization.

Keywords

Biometric Modality, Fusion, Multimodal Biometric, Optimization

Full Text:

 |  (PDF views: 52)

References


  • Wayman J, Jain A, Maltoni D, Maio D. An introduction to biometric authentication systems. Biometric Systems. 2005; 1–20. Crossref
  • Ross A, Jain AK. Multimodal biometrics: An overview:12th European Signal Processing Conference. 2004 Sep 6. p.1221–4.PMid:14982620
  • Ross A, Jain A. Information fusion in biometrics. Pattern recognition letters. 2003 Sep 30; 24(13):2115–25. Crossref
  • Prathipa C, Latha L. A survey of biometric fusion and template security techniques. International Journal of Advanced Research in Computer Engineering and Technology. 2014; 3(10):3511–6.
  • Ghayoumi M. A review of multimodal biometric systems: Fusion methods and their applications. IEEE/ACIS 14th International Conference on Computer and Information Science (ICIS). 2015 Jun 28. p. 131–6.
  • Jain A, Nandakumar K, Ross A. Score normalization in multimodal biometric systems. Pattern recognition. 2005 Dec 31; 38(12): 2270–85. Crossref
  • Jaafar H, Ramli DA. A review of multibiometric system with fusion strategies and weighting factor. International Journal of Computer Science Engineering (IJCSE). 2013; 2(4):158–65.
  • Islam M. Biometric security system using finger geometry and palm print modalities. International Journal of Information Systems and Computer Sciences. 2014 May; 3(3): 16–9.
  • Delac K, Grgic M. A survey of biometric recognition methods.Proceedings Elmar. 2004 Jun 18. p.184–93.
  • Conti V, Militello C, Sorbello F, Vitabile S. A frequencybased approach for features fusion in fingerprint and iris multimodal biometric identification systems. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). 2010 Jul; 40(4): 384–95.Crossref
  • Sim HM, Asmuni H, Hassan R, Othman RM. Multimodal biometrics: Weighted score level fusion based on non-ideal iris and face images. Expert Systems with Applications.2014 Sep 1; 41(11):5390–404. Crossref
  • Sharkey AJC. Linear and order statistics combiners for pattern classification. In combining artificial neural nets: Ensemble and modular multi-net systems, London: Springer-Verlag;1999. 127–61. Crossref Crossref
  • Wu S, McClean S. Performance prediction of data fusion for information retrieval. Information processing and management.2006 Jul 31; 42(4): pp. 899–915. Crossref
  • Chang K, Bowyer KW, Sarkar S, Victor B. Comparison and combination of ear and face images in appearance-based biometrics. IEEE Transactions on pattern analysis and machine intelligence. 2003 Sep; 25(9):1160–5. Crossref
  • Kale A, RoyChowdhury AK, Chellappa R. Fusion of gait and face for human identification. Proceedings of International Conference on Acoustics, Speech, and Signal Processing.2004 May 17; 5: 901–4.
  • Toh KA, Jiang X, Yau WY. Exploiting global and local decisions for multimodal biometrics verification. IEEE Transactions on Signal Processing. 2004 Oct; 52(10): 3059– 72. Crossref
  • Feng G, Dong K, Hu D, Zhang D. When faces are combined with palmprints: A novel biometric fusion strategy.Biometric authentication. 2004; p. 701–7.
  • Fierrez-Aguilar J, Ortega-Garcia J, Gonzalez-Rodriguez J, Bigun J. Discriminative multimodal biometric authentication based on quality measures. Pattern recognition. 2005 May 31; 38(5):777–9. Crossref
  • Yu P, Xu D, Zhou H, Li H. Decision fusion for hand biometric authentication. IEEE International Conference on Intelligent Computing and Intelligent Systems. 2009 Nov 20; 4:486–90.
  • PMid:19361735
  • Kittler J, Hatef M, Duin RP, Matas J. On combining classifiers.IEEE transactions on pattern analysis and machine intelligence. 1998 Mar; 20(3): 226–39. Crossref
  • Kaur M, Girdhar A, Kaur M. Multimodal biometric system using speech and signature modalities. International Journal of Computer Applications. 2010 Aug; 5(12):13-6. Crossref
  • Nandakumar K. Multibiometric systems: Fusion strategies and template security [Doctoral thesis]. Michigan State University. ProQuest. 2008. p. 1–249.
  • Frischholz RW, Dieckmann U. BiolD: A multimodal biometric identification system. Computer. 2000 Feb; 33(2): 64-8. Crossref
  • Brunelli R, Falavigna D. Person identification using multiple cues. IEEE transactions on pattern analysis and machine intelligence. 1995 Oct; 17(10): 955–66. Crossref
  • Cui F, Yang G. Score level fusion of fingerprint and finger vein recognition. Journal of Computational information systems. 2011 Dec; 7(16): 5723–31.
  • Nandakumar K, Chen Y, Dass SC, Jain A. Likelihood ratiobased biometric score fusion. IEEE transactions on pattern analysis and machine intelligence. 2008 Feb; 30(2): 342–7. Crossref PMid:18084063
  • Daniel DM, Monica B. A data fusion technique designed for multimodal biometric systems. 10th International Symposium on Electronics and Telecommunications (ISETC). 2012 Nov 15. p.155–8. Crossref
  • Ross AA, Govindarajan R. Feature level fusion of hand and face biometrics. Defense and Security. Proceedings of SPIE Conference on Biometric Technology for Human Identifiation. 2005 Mar 28; 5779: 196–204.
  • Bigün ES, Bigün J, Duc B, Fischer S. Expert conciliation for multi modal person authentication systems by Bayesian statistics.International Conference on Audio-and Video-Based Biometric Person Authentication. 1997 Mar 12. p. 291–300. Crossref
  • Bigün J, Duc B, Smeraldi F, Fischer S, Makarov A. Multimodal person authentication. Face Recognition. 1998. p. 26–50. Crossref
  • Kartik P, Prasad RV, Prasanna SM. Noise robust multimodal biometric person authentication system using face, speech and signature features. INDICON. 2008 Dec 11. p. 3–7. Crossref
  • Nadheen MF, Poornima S. Fusion in multimodal biometric using iris and ear. IEEE Conference on Information and Communication Technologies (ICT). 2013 Apr 11. p. 83–7. Crossref
  • Elmir Y, Elberrichi Z, Adjoudj R. Multimodal Biometric Using a Hierarchical Fusion of a Person’s Face, Voice, and Online Signature. JIPS. 2014 Dec 1; 10(4): 555–67. Crosserf
  • Kartik P, Prasanna SM, Prasad RV. Multimodal biometric person authentication system using speech and signature features. TENCON. 2008 Nov 19. p.1–6.
  • Fiérrez-Aguilar J, Ortega-Garcia J, Gonzalez-Rodriguez J. Fusion strategies in multimodal biometric verification.Proceedings of International Conference on Multimedia and Expo. 2003 Jul 6. p. 5-8. Crossref
  • Aly OM, Mahmoud TA, Salama GI, Onsi HM. An adaptive multimodal biometrics system using PSO. InternationalJournal of Advanced Computer Science and Applications. 2013 Jul; 4(7): 1–8.
  • Mazouni R, Rahmoun A. On Comparing Verification Performances of Multimodal Biometrics Fusion Techniques. 2011; 33(7): 1–6.
  • Maurer DE, Baker JP. Fusing multimodal biometrics with quality estimates via a Bayesian belief network. Pattern Recognition. 2008 Mar 31; 41(3): 821–32. Crossref
  • Raghavendra R, Dorizzi B, Rao A, Kumar GH. Designing efficient fusion schemes for multimodal biometric systems using face and palmprint. Pattern Recognition. 2011 May 31; 44(5): 1076–88. Crossref
  • Toh KA, Yau WY, Jiang X. A reduced multivariate polynomial model for multimodal biometrics and classifiers fusion. IEEE Transactions on Circuits and Systems for Video Technology. 2004 Feb;14(2): 224–33. Crossref
  • Snelick R, Uludag U, Mink A, Indovina M, Jain A. Largescale evaluation of multimodal biometric authentication using state-of-the-art systems. IEEE transactions on pattern analysis and machine intelligence. 2005 Mar; 27(3): 450–5.Crossref PMid:15747798
  • Fox NA, Gross R, Cohn JF, Reilly RB. Robust biometric person identification using automatic classifier fusion of speech, mouth, and face experts. IEEE Transactions on multimedia. 2007; 9(4):701–14. Crossref
  • Eshwarappa MN, Latte MV. Multimodal Biometric Person Authentication using Speech, Signature and Handwriting Features. International Journal of Advanced Computer Science and Applications, Special Issue on Artificial Intelligence. 2011. 1–10.
  • Abaza A, Ross A. Quality based rank-level fusion in multibiometric systems. 3rd International Conference onBiometrics: Theory, Applications, and Systems. 2009 Sep 28. p. 1–6. Crossref
  • Kumar A, Shekhar S. Palmprint recognition using rank level fusion. 17th IEEE International Conference on Image Processing (ICIP). 2010 Sep 26. p.3121–4. Crossref
  • Monwar MM, Gavrilova ML. Multimodal biometric system using rank-level fusion approach. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics). 2009 Aug; 39(4): 867–78. Crossref PMid:19336340
  • Kumar A, Shekhar S. Personal identification using multibiometrics rank-level fusion. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). 2011 Sep; 41(5): 743–52. Crossref
  • Bhatnagar J, Kumar A, Saggar N. A novel approach to improve biometric recognition using rank level fusion. IEEE Conference on Computer Vision and Pattern Recognition. 2007 Jun 17. p.1–6. Crossref
  • Farah M, Vanderpooten D. An outranking approach for information retrieval. Information Retrieval. 2008 Aug 1; 11(4): 315–34. Crossref
  • Ailon N. Aggregation of partial rankings, p-ratings and top-m lists. Algorithmica. 2010 Jun 1; 57(2): 284–300. Crossref
  • Gawande U, Zaveri M, Kapur A. A novel algorithm for feature level fusion using SVM classifier for multibiometricsbased person identification. Applied Computational Intelligence and Soft Computing. 2013 Jan 1. p.11.
  • Kong A, Zhang D, Kamel M. Palmprint identification using feature-level fusion. Pattern Recognition. 2006 Mar 31; 39(3): 478–87. Crossref
  • Ross A, Govindarajan R. Feature level fusion in biometric systems. Proceedings of Biometric Consortium Conference (BCC). 2004 Sep. p. 1–2. PMCid:PMC3851653
  • Kozik R, Choras M. Combined shape and texture information for palmprint biometrics. ratio. 2010. p. 1–6.
  • Geethanjali N, Thamaraiselvi K. Feature Level Fusion of Multimodal Biometrics and Two Tier Security in ATM System. International Journal of Computer Applications. 2013 Jan 1; 70(14): 1–7. Crossref
  • Gayathri R, Ramamoorthy P. Feature level fusion of palmprint and iris. IJCSI International Journal of Computer Science Issues. 2012 Jul; 9(4): 194–203.
  • Awang S, Yusof R. Fusion of Face and Signature at the Feature Level by using Correlation Pattern Recognition.World Academy of Science, Engineering and Technology. 2011; 59: 2291–6.
  • Awang S, Yusof R, Zamzuri MF, Arfa R. Feature level fusion of face and signature using a modified feature selection technique. International Conference on Signal-Image Technology and Internet-Based Systems (SITIS). 2013 Dec 2. p. 706–13. Crossref
  • Murukesh C, Thanushkodi K. Efficient Multimodal Biometric System Based on Feature Level Fusion of Palmprint and Finger Vein. International Review on Computers and Software (IRECOS). 2013 Dec 31, 8(12), pp. 2903-8.
  • Joshi SC, Kumar A. Design of multimodal biometrics system based on feature level fusion. 10th International Conference on Intelligent Systems and Control (ISCO). 2016 Jan 7, pp. 1-6. Crossref
  • Soliman H, Mohamed AS, Atwan A. Feature level fusion of Palm veins and signature biometrics. International Journal of Video & Image Processing and Network Security IJVIPNS-IJENS. 2012, 12(01), p. 1-12.
  • Rattani A, Kisku DR, Bicego M, Tistarelli M. Feature level fusion of face and fingerprint biometrics. BTAS. 2007 Sep 27, pp. 1-6.
  • Kumar A, Wong D, Shen H, Jain A. Personal verification using palmprint and hand geometry biometric. Audio-and Video-Based Biometric Person Authentication. 2003, pp. 1060-1060. Crossref
  • Feng G, Dong K, Hu D, Zhang D. When faces are combined with palmprints: A novel biometric fusion strategy. Biometric authentication. Springer; 2004. p. 701–7.
  • Soltane M, MIMEN B. Soft Decision Level Fusion Approach to a Combined Behavioral Speech-Signature Biometrics Verification. International Journal of Signal Processing, Image Processing and Pattern Recognition sIJSIP. 2013 Feb; 6(1): 1–16.
  • Chatzis V, Bors AG, Pitas I. Multimodal decision-level fusion for person authentication. IEEE transactions on systems, man, and cybernetics-part a: systems and humans. 1999 Nov; 29(6): 674–80.
  • Hong L, Jain A. Integrating faces and fingerprints for personal identification. IEEE transactions on pattern analysis and machine intelligence. 1998 Dec; 20(12): 1295–307. Crossref
  • Ben-Yacoub S, Abdeljaoued Y, Mayoraz E. Fusion of face and speech data for person identity verification. IEEE transactions on neural networks. 1999 Sep; 10(5): 1065–74. Crossref PMid:18252609
  • Veeramachaneni K, Osadciw LA, Varshney PK. An adaptive multimodal biometric management algorithm. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews). 2005 Aug; 35(3): 344–56. Crossref
  • Kale A, RoyChowdhury AK, Chellappa R. Fusion of gait and face for human identification. Proceedings of International Conference on Acoustics Speech and Signal Proceedings. 2004 May 17; 5: 901–4.
  • Tan X, Bhanu B. Fingerprint matching by genetic algorithms. Pattern Recognition. 2006 Mar 31; 39(3): 465–77. Crossref
  • Scheidat T, Engel A, Vielhauer C. Parameter optimization for biometric fingerprint recognition using genetic algorithms. Proceedings of the 8th Workshop on Multimedia and Security. 2006 Sep 26. p. 130–4. Crossref
  • Rodrigues RN, Ling LL, Govindaraju V. Robustness of multimodal biometric fusion methods against spoof attacks. Journal of Visual Languages and Computing. 2009 Jun 30; 20(3): 169–79. Crossref
  • Palanivel S, Yegnanarayana B. Multimodal person authentication using speech, face and visual speech. Computer Vision and Image Understanding. 2008 Jan 31; 109(1): 44–55. Crossref
  • Awang S, Yusof R, Zamzuri MF, Arfa R. Feature level fusion of face and signature using a modified feature selection technique. International Conference on Signal-Image Technology and Internet-Based Systems (SITIS). 2013 Dec 2. p. 706–13. Crossref
  • Raghavendra R, Rao A, Hemantha Kumar G. Multisensor biometric evidence fusion of face and palmprint for person authentication using particle swarm optimisation (pso). International Journal of Biometrics. 2009 Dec 16; 2(1): 19–33. Crossref

Refbacks

  • There are currently no refbacks.


Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.