A Framework to Detect and Classify Time-based Concept Drift

M Thangam; A Bhuvaneswari; J Sangeetha

doi:10.17485/IJST/v16i48.583

Article

A Framework to Detect and Classify Time-based Concept Drift

VIEWS 180
PDF 52

Indian Journal of Science and Technology

DOI: 10.17485/IJST/v16i48.583

Year: 2023, Volume: 16, Issue: 48, Pages: 4631-4637

Original Article

A Framework to Detect and Classify Time-based Concept Drift

M Thangam^1*, A Bhuvaneswari¹, J Sangeetha¹

¹Associate Professor, Cauvery College for Women (Autonomous), [Affiliated to Bharathidasan University], Trichy, Tamil Nadu, India

*Corresponding Author
Email: [email protected]

Received Date:14 March 2023, Accepted Date:24 November 2023, Published Date:28 December 2023

This work is licensed under a Creative Commons Attribution 4.0 International License.

Abstract

Objectives: To design a framework that performs time series decomposition to detect and classify the types of concept drift in a data stream. The aim of this research is to increase the classification accuracy in the detection and classification of drifts. Methods: The proposed method is validated using the Beijing PM2.5 dataset available in the UCI Machine Learning Repository. This dataset has 13 attributes and experiments were performed with the existing drift detection framework algorithms such as EFCDD, Meta-ADD, CIDD, and comparisons were performed with the proposed TBD framework. The outcome of this research is aggregated with Classification accuracy. An effective algorithm selection framework is presented that detects and classifies time-based concept drift existing in the data. The temporal aspects of the data are decomposed to determine the algorithm to be applied to detect and classify the types of drifts. Depending on the decomposed levels, three varied algorithms have been applied and used for the effective detection and classification of time-based drifts. Findings: The performance of the proposed method is validated using the classification accuracy and compared with the existing drift detection framework algorithms. The proposed framework achieves maximum classification accuracy of 95.24% than all the other existing methods. Novelty: A novel framework has been proposed with better classification accuracy for the detection and classification of time-based concept drift.

Keywords: Feature Selection, Concept Drift, Multiple Drift Detection, Timeseries decomposition, Classification Accuracy

References

Agrahari S, Singh AK. Concept Drift Detection in Data Stream Mining : A literature review. Journal of King Saud University - Computer and Information Sciences. 2022;34(10, Part B):9523–9540. Available from: https://doi.org/10.1016/j.jksuci.2021.11.006
Kabir MA, Begum S, Ahmed MU, Rehman AU. CODE: A Moving-Window-Based Framework for Detecting Concept Drift in Software Defect Prediction. Symmetry. 2022;14(12):1–20. Available from: https://doi.org/10.3390/sym14122508
Manickaswamy T, Bhuvaneswari A. Concept drift in data stream classification using ensemble methods: types, methods and challenges. INFOCOMP Journal of Computer Science. 2020;19(2):163–174. Available from: https://infocomp.dcc.ufla.br/index.php/infocomp/article/view/650
Sanjith SL, Raj EG. Drift Detection Based Model Selection Framework For Real-Time Anomaly Detection In Iot. 2019. Available from: https://www.semanticscholar.org/paper/Drift-Detection-Based-Model-Selection-Framework-For-SanjithS-Raj/c7398d2f9f1d5232dce42e6a741e0a9422e02205
Prasad KSN, Rao AS, Ramana AV. Ensemble framework for concept-drift detection in multidimensional streaming data. International Journal of Computers and Applications. 2022;44(12):1193–1200. Available from: https://doi.org/10.1080/1206212X.2020.1711617
Shan J, Zhang H, Liu W, Liu Q. Online Active Learning Ensemble Framework for Drifted Data Streams. IEEE Transactions on Neural Networks and Learning Systems. 2019;30(2):486–498. Available from: https://ieeexplore.ieee.org/document/8401336
Khamassi I, Sayed-Mouchaweh M, Hammami M, Ghédira K. A New Combination of Diversity Techniques in Ensemble Classifiers for Handling Complex Concept Drift. In: Learning from Data Streams in Evolving Environments, Studies in Big Data. (Vol. 41, pp. 39-61) Springer, Cham. 2018.
Li Z, Huang W, Xiong Y, Ren S, Zhu T. Incremental learning imbalanced data streams with concept drift: The dynamic updated ensemble algorithm. Knowledge-Based Systems. 2020;195:105694. Available from: https://doi.org/10.1016/j.knosys.2020.105694
Zheng X, Li P, Hu X, Yu K. Semi-supervised classification on data streams with recurring concept drift and concept evolution. Knowledge-Based Systems. 2021;215:106749. Available from: https://doi.org/10.1016/j.knosys.2021.106749
Pratama M, Pedrycz W, Webb GI. An Incremental Construction of Deep Neuro Fuzzy System for Continual Learning of Non-stationary Data Streams. IEEE Transactions on Fuzzy Systems. 2020;28(7):1315–1328. Available from: https://doi.org/10.1109/TFUZZ.2019.2939993
Priya S, Uthra RA. Deep learning framework for handling concept drift and class imbalanced complex decision-making on streaming data. Complex & Intelligent Systems. 2023;9(4):3499–3515. Available from: https://doi.org/10.1007/s40747-021-00456-0
Yu H, Zhang Q, Liu T, Lu J, Wen Y, Zhang G. Meta-ADD: A meta-learning based pre-trained model for concept drift active detection. Information Sciences. 2022;608:996–1009. Available from: https://doi.org/10.1016/j.ins.2022.07.022
Mayaki MZA, Riveill M. Autoregressive based Drift Detection Method. In: 2022 International Joint Conference on Neural Networks (IJCNN). Padua, Italy, 18-23 July 2022. IEEE. p. 1–8.
Yu S, Abraham Z, Wang H, Shah M, Wei Y, Príncipe JC. Concept drift detection and adaptation with hierarchical hypothesis testing. Journal of the Franklin Institute. 2019;356(5):3187–3215. Available from: https://doi.org/10.1016/j.jfranklin.2019.01.043
Thangam M, Bhuvaneswari A. Linear Stochastic Feature Embedding based Regressive MIL Boost Data Classification for Streaming Data. Solid State Technology. 2020;63(4). Available from: https://solidstatetechnology.us/index.php/JSST/article/view/8342
Thangam M, Bhuvaneswari A. An Adaptive Statistical Stochastic Deep Gradient Learning for Handling Recurring and Incremental Drifts. In: Proceedings of the 2nd International Conference on Recent Trends in Machine Learning, IoT, Smart Cities and Applications, Lecture Notes in Networks and Systems. (Vol. 237, pp. 295-308) Springer Nature Singapore. 2022.
Thangam M, Bhuvaneswari A. Exponential kernelized feature map Theil-Sen regression-based deep belief neural learning classifier for drift detection with data stream. International Journal of Advanced Technology and Engineering Exploration. 2022;9(90):663–675. Available from: https://doi.org/10.19101/IJATEE.2021.874851
Ouyang Z, Ravier P, Jabloun M. STL Decomposition of Time Series Can Benefit Forecasting Done by Statistical Methods but Not by Machine Learning Ones. In: Engineering Proceedings: The 7th International conference on Time Series and Forecasting. (Vol. 5 (1), pp. 1-10) MDPI. 2021.

Copyright

© 2023 Thangam et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Published By Indian Society for Education and Environment (iSee)