• P-ISSN 0974-6846 E-ISSN 0974-5645

Indian Journal of Science and Technology


Indian Journal of Science and Technology

Year: 2023, Volume: 16, Issue: 33, Pages: 2601-2608

Original Article

An Entropy Based Alternate Approach to Develop an Ensemble Classifier

Received Date:12 January 2023, Accepted Date:08 July 2023, Published Date:01 September 2023


Objectives: To develop an alternative approach to improve the performance of ensemble classifiers. Methods: The Principle of Maximum Entropy and a precision based diversity measure are used to develop the model. Here joint entropy values are used which strongly reflect the combined uncertainties in the actual prediction and the prediction obtained during the training phase. Towards that purpose probabilistic confusion matrix has been used. The performance of the proposed method is tested against twenty different datasets. Each dataset is different from one another in terms of the number of classes and features. The results have been compared with several existing state of art ensemble methods uch as Bagging, AdaBoost, Naive Bayes (NB), Weighted Majority Vote (WMV) and TransEnsemble Classifier (TrEnL). Findings:The results show that the proposed method can select the best among the classifiers and perform better when compared to conventional classifiers. Novelty: The maximum entropy principle is applied at the final prediction probability matrix so that the method can be used as a generalized technique to improve the performance of ensemble classifiers.

Keywords: Ensemble; Maximum Entropy; Confusion Matrix; Weighted Entropy; Probabilistic Confusion Matrix


  1. Yazdizadeh A, Patterson Z, Farooq B. Ensemble Convolutional Neural Networks for Mode Inference in Smartphone Travel Survey. IEEE Transactions on Intelligent Transportation Systems. 2020;21(6):2232–2239. Available from: https://doi.org/10.1109/TITS.2019.2918923
  2. Jan MZ, Munoz JC, Ali MA. A novel method for creating an optimized ensemble classifier by introducing cluster size reduction and diversity. IEEE Transactions on Knowledge and Data Engineering. 2020;2022(7):1. Available from: https://doi.org/10.1109/TKDE.2020.3025173
  3. Sridhar S, Sanagavarapu S. Detection and Prognosis Evaluation of Diabetic Retinopathy using Ensemble Deep Convolutional Neural Networks. 2020 International Electronics Symposium (IES). 2020. Available from: https://doi.org/10.1109/IES50839.2020.9231789
  4. Sravanthi N, Venkat ML, Harshini S, Ashesh K. An Ensemble Approach to Predict Weather Forecast using Machine Learning. 2020 International Conference on Smart Electronics and Communication (ICOSEC). 2020. Available from: https://doi.org/10.1109/ICOSEC49089.2020.9215444
  5. Wang K, Hu T, Zhao B. An Unsupervised Deep Neural Network Approach Based on Ensemble Learning to Suppress Seismic Surface-Related Multiples. IEEE Transactions on Geoscience and Remote Sensing. 2022;60:1–14. Available from: https://doi.org/10.1109/TGRS.2022.3225809
  6. Zhai P, Hou T, Ji X, Dong Z, Zhang L. Robust Adaptive Ensemble Adversary Reinforcement Learning. IEEE Robotics and Automation Letters. 2022;7(4):12562–12568. Available from: https://doi.org/10.1109/LRA.2022.3220531
  7. Pamila JCMJ, Selvi RS, Santhi P, Nithya TM. Ensemble classifier based big data classification with hybrid optimal feature selection. Advances in Engineering Software. 2022;173:103183. Available from: https://doi.org/10.1016/j.advengsoft.2022.103183


© 2023 Sekhar & Sreeni. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)


Subscribe now for latest articles and news.