eprintid: 19369
rev_number: 2
eprint_status: archive
userid: 1
dir: disk0/00/01/93/69
datestamp: 2024-06-04 14:11:49
lastmod: 2024-06-04 14:11:49
status_changed: 2024-06-04 14:05:34
type: article
metadata_visibility: show
creators_name: Palli, A.S.
creators_name: Jaafar, J.
creators_name: Hashmani, M.A.
creators_name: Gomes, H.M.
creators_name: Alsughayyir, A.
creators_name: Gilal, A.R.
title: Combined Effect of Concept Drift and Class Imbalance on Model Performance during Stream Classification
ispublished: pub
keywords: Data streams; Smart city, Class imbalance; Class imbalance ratio; Combined effect; Concept class; Concept drifts; Data stream; Modeling performance; Nonstationary data; Performance, Classification (of information)
note: cited By 3
abstract: Every application in a smart city environment like the smart grid, health monitoring, security, and surveillance generates non-stationary data streams. Due to such nature, the statistical properties of data changes over time, leading to class imbalance and concept drift issues. Both these issues cause model performance degradation. Most of the current work has been focused on developing an ensemble strategy by training a new classifier on the latest data to resolve the issue. These techniques suffer while training the new classifier if the data is imbalanced. Also, the class imbalance ratio may change greatly from one input stream to another, making the problem more complex. The existing solutions proposed for addressing the combined issue of class imbalance and concept drift are lacking in understating of correlation of one problem with the other. This work studies the association between concept drift and class imbalance ratio and then demonstrates how changes in class imbalance ratio along with concept drift affect the classifier�s performance. We analyzed the effect of both the issues on minority and majority classes individually. To do this, we conducted experiments on benchmark datasets using state-of-the-art classifiers especially designed for data stream classification. Precision, recall, F1 score, and geometric mean were used to measure the performance. Our findings show that when both class imbalance and concept drift problems occur together the performance can decrease up to 15. Our results also show that the increase in the imbalance ratio can cause a 10 to 15 decrease in the precision scores of both minority and majority classes. The study findings may help in designing intelligent and adaptive solutions that can cope with the challenges of non-stationary data streams like concept drift and class imbalance. © 2023 Tech Science Press. All rights reserved.
date: 2023
official_url: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85148002256&doi=10.32604%2fcmc.2023.033934&partnerID=40&md5=ba23c534daeda11666d75a5d6b0f2cd8
id_number: 10.32604/cmc.2023.033934
full_text_status: none
publication: Computers, Materials and Continua
volume: 75
number: 1
pagerange: 1827-1845
refereed: TRUE
citation:   Palli, A.S. and Jaafar, J. and Hashmani, M.A. and Gomes, H.M. and Alsughayyir, A. and Gilal, A.R.  (2023) Combined Effect of Concept Drift and Class Imbalance on Model Performance during Stream Classification.  Computers, Materials and Continua, 75 (1).  pp. 1827-1845.