A Stacked Ensemble Deep Learning Approach for Imbalanced Multi-Class Water Quality Index Prediction
Source abstract
Abstract
A common difficulty in building prediction models with realworld environmental datasets is the skewed distribution of classes. There are significantly more samples for day-to-day classes, while rare events such as polluted classes are uncommon. Consequently, the limited availability of minority outcomes lowers the classifier’s overall reliability. This study assesses the capability of machine learning (ML) algorithms in tackling imbalanced water quality data based on the metrics of precision, recall, and F1 score. It intends to balance the misled accuracy towards the majority of data. Hence, 10 ML algorithms of its performance are compared. The classifiers included are AdaBoost, Support Vector Machine, Linear Discriminant Analysis, k-Nearest Neighbors, Naïve Bayes, Decision Trees, Random Forest, Extra Trees, Bagging, and the Multilayer Perceptron. This study also uses the Easy Ensemble Classifier, Balanced Bagging, and RUSBoost algorithm to evaluate multi-class imbalanced learning methods. The comparison results revealed that a highaccuracy machine learning model is not always good in recall and sensitivity. This paper’s stacked ensemble deep learning (SE-DL) generalization model effectively classifies the water quality index (WQI) based on 23 input variables. The proposed algorithm achieved a remarkable average of 95.69%, 94.96%, 92.92%, and 93.88% for accuracy, precision, recall, and F1 score, respectively. In addition, the proposed model is compared against two state-of-the-art classifiers, the XGBoost (eXtreme Gradient Boosting) and Light Gradient Boosting Machine, where performance metrics of balanced accuracy and g-mean are included. The experimental setup concluded XGBoost with a higher balanced accuracy and G-mean. However, the SE-DL model has a better and more balanced performance in the F1 score. The SE-DL model aligns with the goal of this study to ensure the balance between accuracy and completeness for each water quality class. The proposed algorithm is also capable of higher efficiency at a lower computational time against using the standard Synthetic Minority Oversampling Technique (SMOTE) approach to imbalanced datasets.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Imbalanced Data Classification Techniques · Data Stream Mining Techniques · Water Quality Monitoring Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (56)
Show source-provided references
1. Hinrichsen · The Linkages Between Population and Water · 2002 · 1
2. Anthropogenic activity-induced water quality degradation in the Loktak lake, a Ramsar site in the Indo-burma biodiversity hotspot
3. Evaluation of water quality in the south-to-north water diversion project of China using the water quality index (WQI) method10.1016/j.watres.2020.115781 ↗
4. Planetscope nanosatellites image classification using machine learning10.32604/csse.2022.023221 ↗
5. CNN based automated weed detection system using UAV imagery10.32604/csse.2022.023016 ↗
6. SMOTEDNN: A novel model for air pollution forecasting and AQI classification10.32604/cmc.2022.021968 ↗
7. Sentiment analysis using machine learning: Progress in the machine intelligence for data science10.1016/j.seta.2022.102557 ↗
8. Fine-tuned convolutional neural network for different cardiac view classification10.1007/s11227-022-04587-0 ↗
9. Insider threat detection based on NLP word embedding and machine learning10.32604/iasc.2022.021430 ↗
10. Water quality assessment of a river using deep learning Bi-LSTM methodology: Forecasting and validation
11. Analysis and prediction of water quality using LSTM deep neural networks in IoT environment
12. Water quality analysis in a lake using deep learning methodology: Prediction and validation
13. Machine-learning classifiers for imbalanced tornado data10.1007/s10287-013-0174-6 ↗
14. An experimental study with imbalanced classification approaches for credit card fraud detection10.1109/ACCESS.2019.2927266 ↗
15. Enhancement of hepatitis virus immunoassay outcome predictions in imbalanced routine pathology data by data balancing and feature selection before the application of support vector machines10.1186/s12911-017-0522-5 ↗
16. Imbalanced learning for air pollution by meta-cognitive online sequential extreme learning machine10.1007/s12559-014-9301-0 ↗
17. Two novelty learning models developed based on deep cascade forest to address the environmental imbalanced issues: A case study of drinking water quality prediction10.1016/j.envpol.2021.118153 ↗
18. A systematic review on imbalanced data challenges in machine learning: Applications and solutions
19. Learning from class-imbalanced data: Review of methods and applications10.1016/j.eswa.2016.12.035 ↗
20. A comparative evaluation of outlier detection algorithms: Experiments and analyses10.1016/j.patcog.2017.09.037 ↗
21. A priori synthetic over-sampling methods for increasing classification sensitivity in imbalanced data sets10.1016/j.eswa.2016.09.010 ↗
22. Efficient treatment of outliers and class imbalance for diabetes prediction10.1016/j.artmed.2020.101815 ↗
23. Boosting methods for multi-class imbalanced data classification: An experimental review10.1186/s40537-020-00349-y ↗
24. The study of under-and over-sampling methods’ utility in analysis of highly imbalanced data on osteoporosis10.1016/j.ins.2016.09.038 ↗
25. Evolutionary undersampling boosting for imbalanced classification of breast cancer malignancy10.1016/j.asoc.2015.08.060 ↗
26. Distributional random oversampling for imbalanced text classification
27. SMOTE for learning from imbalanced data: Progress and challenges, marking the 15-year anniversary10.1613/jair.1.11192 ↗
28. Imbalanced dataset classification and solutions: A review
29. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
30. Kaur · ICT Based Innovations · 2018 · 2310.1007/978-981-10-6602-3_3 ↗
31. Imbalanced classification in sparse and large behaviour datasets10.1007/s10618-017-0517-y ↗
32. HCAB-SMOTE: A hybrid clustered affinitive borderline SMOTE approach for imbalanced data binary classification10.1007/s13369-019-04336-1 ↗
33. Class-imbalanced dynamic financial distress prediction based on Adaboost-SVM ensemble combined with SMOTE and time weighting10.1016/j.inffus.2019.07.006 ↗
34. A predictive model of recreational water quality based on adaptive synthetic sampling algorithms and machine learning10.1016/j.watres.2020.115788 ↗
35. Proposition of new ensemble data-intelligence models for surface water quality prediction10.1109/ACCESS.2021.3100490 ↗
36. Comparative analysis of surface water quality prediction performance and identification of key water parameters using different machine learning models based on big data10.1016/j.watres.2019.115454 ↗
37. Multi-step ahead modelling of river water quality parameters using ensemble artificial intelligence-based approach10.1016/j.jhydrol.2019.123962 ↗
38. Ensemble learning for data stream analysis: A survey10.1016/j.inffus.2017.02.004 ↗
39. Imbalanced classification in diabetics using ensembled machine learning10.32604/cmc.2022.025865 ↗
40. Environmental Quality Report (EQR) 2008 · 2008
41. Stacked generalization10.1016/S0893-6080(05)80023-1 ↗
42. Xgboost: A scalable tree boosting system
43. Light GBM: A highly efficient gradient boosting decision tree
44. Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning
45. Correlation between conductivity and total dissolved solid in various type of water: A review
46. Factors influencing corrosion of metal pipes in soils10.1007/s10311-018-0731-x ↗
47. Phycoremediation of nitrogen and phosphate from wastewater using Picochlorum sp.: A tenable approach
48. The presence of toxic and non-toxic cyanobacteria in the sediments of the Limpopo river basin: Implications for human health10.3390/toxins10070269 ↗
49. Application of artificial intelligence (AI) techniques in water quality index prediction: A case study in tropical region, Malaysia10.1007/s00521-016-2404-7 ↗
50. Water quality prediction model based support vector machine model for ungauged river catchment under dual scenarios
51. Optimisation of water demand forecasting by artificial intelligence with short data sets10.1016/j.biosystemseng.2018.03.011 ↗
52. Prediction of water quality classification of the kelantan river basin, Malaysia, using machine learning techniques10.3390/w14071067 ↗
53. Identification of suitable technologies for drinking water quality prediction: A comparative study of traditional, ensemble, cost-sensitive, outlier detection learning models and sampling algorithms10.1021/acsestwater.1c00037 ↗
54. A neural network-based ensemble approach for spam detection in Twitter10.1109/TCSS.2018.2878852 ↗
55. A smart healthcare monitoring system for heart disease prediction based on ensemble deep learning and feature fusion10.1016/j.inffus.2020.06.008 ↗
56. Feature selection in machine learning: A new perspective10.1016/j.neucom.2017.11.077 ↗