Impact of Unbalanced Classification on the Performance of Software Defect Prediction Models

K J Eldho

doi:10.17485/IJST/v15i6.2193

Article

Impact of Unbalanced Classification on the Performance of Software Defect Prediction Models

VIEWS 1362
PDF 209

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v15i6.2193

Year: 2022, Volume: 15, Issue: 6, Pages: 237-242

Original Article

Impact of Unbalanced Classification on the Performance of Software Defect Prediction Models

K J Eldho^1*

¹Assistant Professor, Department of Computer Science, Mary Matha Govt Aided Arts & Science College, Mananthavady, Kerala

*Corresponding Author
Email: [email protected]

Received Date:25 November 2021, Accepted Date:23 January 2022, Published Date:16 February 2022

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objectives: To propose a suitable imbalanced data classification model to split the dataset into two new datasets and to test the created imbalanced dataset by the prediction models. Methods: The imbalance defect data sets are taken from the PROMISE library and used for the performance evaluation. The results clearly demonstrate that the performance of three existing prediction classifier models, K-Nearest Neighbor (KNN), Naive Bayes (NB), and Back Propagation (BPN), is very susceptible in terms of unbalance of classification, while Support Vector Machine (SVM) and Extreme Learning Machine (ELM) are more stable. Findings: The outcome of this research reveals that applied SVM and ELM machine learning models improves the performance in defect prediction and records 29% more than KNN, and 19% more than NB and BPN. Novelty: According to the findings of a comprehensive study, the proposed machine learning new classification imbalance impact analysis method outperforms the existing ones in order to transform the original imbalance data set into a new data set with an increasing imbalance rate and be able to select models to evaluate different predictions on the new data set.

Keywords: Software Fault Prediction Model; Imbalance Problem Classification; Artificial Intelligence; Smart Debugging; Unbalanced Classification

References

Pandey SK, Tripathi AK. Class Imbalance Issue in Software Defect Prediction Models by various Machine Learning Techniques: An Empirical Study. 2021 8th International Conference on Smart Computing and Communications (ICSCC). 2021;2021:58–63. Available from: https://doi.org/10.1109/ICSCC51209.2021.9528170
Makki S, Assaghir Z, Taher Y, Haque R, Hacid MS, Zeineddine H. An Experimental Study With Imbalanced Classification Approaches for Credit Card Fraud Detection. IEEE Access. 2019;7:93010–93022. Available from: https://dx.doi.org/10.1109/access.2019.2927266
Thabtah F, Hammoud S, Kamalov F, Gonsalves A. Data imbalance in classification: Experimental evaluation. Information Sciences. 2020;513:429–441. Available from: https://dx.doi.org/10.1016/j.ins.2019.11.004
Mohammed A, Podila PSB, Davis RL, Ataga KI, Hankins JS, Kamaleswaran R. Machine learning predicts early-onset acute organ failure in critically ill patients with sickle cell disease. bioRxiv. 2019;p. 614941. Available from: https://doi.org/10.1101/614941
Liu W, Wang B, Wang W. Deep Learning Software Defect Prediction Methods for Cloud Environments Research. Scientific Programming. 2021;2323100:1–11. Available from: https://doi.org/10.1155/2021/2323100
Majd A, Vahidi-Asl M, Khalilian A, Poorsarvi-Tehrani P, Haghighi H. SLDeep: Statement-level software defect prediction using deep-learning model on static code features. Expert Systems with Applications. 2020;147:113156. Available from: https://dx.doi.org/10.1016/j.eswa.2019.113156
Bowes D, Hall T, Petrić J. Software defect prediction: do different classifiers find the same defects? Software Quality Journal. 2018;26(2):525–552. Available from: https://dx.doi.org/10.1007/s11219-016-9353-3
Xia X, Lo D, Pan SJ, Nagappan N, Wang X. HYDRA: Massively Compositional Model for Cross-Project Defect Prediction. IEEE Transactions on Software Engineering. 2016;42(10):977–998. Available from: https://dx.doi.org/10.1109/tse.2016.2543218
Wu J, Wu Y, Niu N, Zhou M. MHCPDP: multi-source heterogeneous cross-project defect prediction via multi-source transfer learning and autoencoder. Software Quality Journal. 2021;p. 1–26. Available from: https://dx.doi.org/10.1007/s11219-021-09553-2
Shrikanth NC, Majumder S, Menzies T. Early Life Cycle Software Defect Prediction. Why? How. 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). 2021;p. 448–459. Available from: https://doi.org/10.1109/ICSE43902.2021.00050
Rtayli N, Enneya N. Enhanced credit card fraud detection based on SVM-recursive feature elimination and hyper-parameters optimization. Journal of Information Security and Applications. 2020;55:102596. Available from: https://dx.doi.org/10.1016/j.jisa.2020.102596
Mohammed A, Podila PSB, Davis RL, Ataga KI, Hankins JS, Kamaleswaran RS. Machine learning predicts early-onset acute organ failure in critically ill patients with sickle cell disease. bioRxiv. 2019;p. 614941. Available from: https://doi.org/10.1101/614941
Pandey SK, Tripathi AK. An empirical study toward dealing with noise and class imbalance issues in software defect prediction. Soft Computing. 2021;25(21):13465–13492. Available from: https://dx.doi.org/10.1007/s00500-021-06096-3
Xu Y, Yu Z, Chen CLP, Cao W. A Novel Classifier Ensemble Method Based on Subspace Enhancement for High-Dimensional Data Classification. IEEE Transactions on Knowledge and Data Engineering. 2021;p. 1. Available from: https://dx.doi.org/10.1109/tkde.2021.3087517
Ijaz M, Alfian G, Syafrudin M, Rhee J. Hybrid Prediction Model for Type 2 Diabetes and Hypertension Using DBSCAN-Based Outlier Detection, Synthetic Minority Over Sampling Technique (SMOTE), and Random Forest. Applied Sciences. 2018;8(8):1325. Available from: https://dx.doi.org/10.3390/app8081325
Liu B, Tsoumakas G. Dealing with class imbalance in classifier chains via random undersampling. Knowledge-Based Systems. 2020;192:105292. Available from: https://dx.doi.org/10.1016/j.knosys.2019.105292
Peng P, Zhang W, Zhang Y, Xu Y, Wang H, Zhang H. Cost sensitive active learning using bidirectional gated recurrent neural networks for imbalanced fault diagnosis. Neurocomputing. 2020;407:232–245. Available from: https://dx.doi.org/10.1016/j.neucom.2020.04.075
SN. Quality of service enabled intelligent water drop algorithm based routing protocol for dynamic link failure detection in wireless sensor network. Indian Journal of Science and Technology. 2020;13(16):1641–1647. Available from: https://dx.doi.org/10.17485/ijst/v13i16.19
Siers MJ, Islam MZ. Novel algorithms for cost-sensitive classification and knowledge discovery in class imbalanced datasets with an application to NASA software defects. Information Sciences. 2018;459:53–70. Available from: https://dx.doi.org/10.1016/j.ins.2018.05.035
Pandit M, Gupta D, Anand D, Goyal N, Aljahdali HM, Mansilla AO, et al. Towards Design and Feasibility Analysis of DePaaS: AI Based Global Unified Software Defect Prediction Framework. Applied Sciences. 2022;12(1):493. Available from: https://dx.doi.org/10.3390/app12010493
Pal S, Sillitti A. A Classification of Software Defect Prediction Models. 2021 International Conference "Nonlinearity, Information and Robotics" (NIR). 2021;2021:1–6. Available from: https://doi: 10.1109/NIR52917.2021.9666110

Copyright

© 2022 Eldho. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Published By Indian Society for Education and Environment (iSee)