journal article·2025-05-06Open access

Rough Set Theory and Soft Computing Methods for Building Explainable and Interpretable AI/ML Models

Sami Naouali, Oussama El Othmani

Applied Sciences· Volume 15· Issue 9

Abstract

This study introduces a novel framework leveraging Rough Set Theory (RST)-based feature selection—MLReduct, MLSpecialReduct, and MLFuzzyRoughSet—to enhance machine learning performance on uncertain data. Applied to a private cardiovascular dataset, our MLSpecialReduct algorithm achieves a peak Random Forest accuracy of 0.99 (versus 0.85 without feature selection), while MLFuzzyRoughSet improves accuracy to 0.83, surpassing our MLVarianceThreshold (0.72–0.77), an adaptation of the traditional VarianceThreshold method. We integrate these RST techniques with preprocessing (discretization, normalization, encoding) and compare them against traditional approaches across classifiers like Random Forest and Naive Bayes. The results underscore RST’s edge in accuracy, efficiency, and interpretability, with MLSpecialReduct leading in minimal attribute reduction. Against baseline classifiers without feature selection and MLVarianceThreshold, our framework delivers significant improvements, establishing RST as a vital tool for explainable AI (XAI) in healthcare diagnostics and IoT systems. These findings open avenues for future hybrid RST-ML models, providing a robust, interpretable solution for complex data challenges.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Rough Sets and Fuzzy Logic · Explainable Artificial Intelligence (XAI) · Neural Networks and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Information Systems Department, College of Computer Science and Information Technology, King Faisal University, Al Ahsa 31982, Saudi Arabia

Information Systems Department, Military Academy of Fondouk Jedid, Nabeul 8012, Tunisia

References (43)

Show source-provided references
1. Fuzzy Rough Set Theory-Based Feature Selection: A Review
2. A new multi-objective decision-making method with diversified weights and Pythagorean fuzzy rough sets10.1016/j.cie.2023.109406 ↗
3. Singh, A., Singh, A., Sharma, H.K., and Majumder, S. (2023). Criteria selection of housing loan based on dominance-based rough set theory: An Indian case. J. Risk Finan. Manag., 16.10.3390/jrfm16070309 ↗
4. Selecting critical features for data classification based on machine learning methods10.1186/s40537-020-00327-4 ↗
5. A framework of index system for gauging the sustainability of Iranian provinces by fusing Analytical Hierarchy Process (AHP) and Rough Set Theory (RST)10.1016/j.seps.2024.101975 ↗
6. Strasser, S., and Klettke, M. (2024, January 14). Transparent Data Preprocessing for Machine Learning. Proceedings of the 2024 Workshop on Human-In-the-Loop Data Analytics, Santiago, Chile.10.1145/3665939.3665960 ↗
7. An embedded feature selection method for imbalanced data classification10.1109/JAS.2019.1911447 ↗
8. AI-driven intelligent data analytics and predictive analysis in Industry 4.0: Transforming knowledge, innovation, and efficiency
9. Islam, A., Majumder, Z.H., Miah, S., and Jannaty, S. (2024). Precision healthcare: A deep dive into machine learning algorithms and feature selection strategies for accurate heart disease prediction. Comput. Biol. Med., 176.10.1016/j.compbiomed.2024.108432 ↗
10. Feature selection techniques for machine learning: A survey of more than two decades of research10.1007/s10115-023-02010-5 ↗
11. Clinical decision support system based on RST with machine learning for medical data classification10.1007/s11042-023-16802-y ↗
12. Group decision-making method with Pythagorean fuzzy rough number for the evaluation of best design concept10.1007/s41066-023-00391-0 ↗
13. Chen, T., and Carlos, G. (2016, January 13–17). Xgboost: A scalable tree boosting system. Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
14. Feature selection for imbalanced data based on neighborhood rough sets10.1016/j.ins.2019.01.041 ↗
15. Tri-level attribute reduction in rough set theory10.1016/j.eswa.2021.116187 ↗
16. Hybridization of rough set–wrapper method with regularized combinational LSTM for seasonal air quality index prediction10.1007/s00521-023-09220-6 ↗
17. Financial risk early warning model for listed companies using bp neural network and rough set theory10.1109/ACCESS.2024.3367228 ↗
18. Boundary-wise loss for medical image segmentation based on fuzzy rough sets10.1016/j.ins.2024.120183 ↗
19. Rough set theory applied to finite dimensional vector spaces10.1016/j.ins.2023.120072 ↗
20. An intelligent recommender system using machine learning association rules and rough set for disease prediction from incomplete symptom set10.1016/j.dajour.2024.100468 ↗
21. Combination of deep learning models for student’s performance prediction with a development of entropy weighted rough set feature mining10.1080/01969722.2023.2166259 ↗
22. Sequential rough set: A conservative extension of Pawlak’s classical rough set10.1007/s10462-024-10976-z ↗
23. Data classification using rough set and bioinspired computing in healthcare applications—An extensive review10.1007/s11042-022-13776-1 ↗
24. Enhancing classification with hybrid feature selection: A multi-objective genetic algorithm for high-dimensional data10.1016/j.eswa.2024.124518 ↗
25. Feature selection based on weighted fuzzy rough sets10.1109/TFUZZ.2024.3387571 ↗
26. Rough set theory and its applications in data mining
27. Yadav, J. (2023). Fuzzy Logic and Fuzzy Set Theory: Overview of Mathematical Preliminaries. Fuzzy Systems Modeling in Environmental and Health Risk Assessment, Elsevier.10.1002/9781119569503.ch1 ↗
28. Guo, X., and Li, H. (2024). Attribute reduction algorithm of rough sets based on spatial optimization. arXiv.
29. Pulinkala, G. (2023). Predicting Biomarkers/Candidate Genes Involved in iALL Using Rough Sets Based Interpretable Machine Learning Model. [Master’s Thesis, Uppsala University]. Available online: https://www.diva-portal.org/smash/get/diva2:1803700/FULLTEXT01.pdf.
30. Neighborhood rough residual network–based outlier detection method in IoT-enabled maritime transportation systems10.1109/TITS.2023.3285615 ↗
31. Hybrid interpretable model using roughset theory and association rule mining to detect interaction terms in a generalized linear model10.1016/j.eswa.2023.121092 ↗
32. Guo, S., Han, L., and Guo, Y. (2024). Advanced Technologies in Healthcare, Springer.10.1007/978-981-99-9585-1 ↗
33. FRCNN: A Combination of Fuzzy-Rough-Set-Based Feature Discretization and Convolutional Neural Network for Segmenting Subretinal Fluid Lesions10.1109/TFUZZ.2024.3473310 ↗
34. Comparison of discretization methods for classifier decision trees and decision rules on medical data sets
35. A Deep-learned embedding technique for categorical features encoding10.1109/ACCESS.2021.3104357 ↗
36. Normalization techniques in training dnns: Methodology, analysis and application10.1109/TPAMI.2023.3250241 ↗
37. The Role of Attribute Normalization in Data Preprocessing for Machine Learning10.1016/j.knosys.2019.01.015 ↗
38. Cabello-Solorzano, K., Ortigosa de Araujo, I., Peña, M., Correia, L., and Tallón-Ballesteros, A.J. (2023). The impact of data normalization on the accuracy of machine learning algorithms: A comparative analysis. International Conference on Soft Computing Models in Industrial and Environmental Applications, Springer.10.1007/978-3-031-42536-3_33 ↗
39. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy10.1109/TPAMI.2005.159 ↗
40. Beyond XGBoost and SHAP: Unveiling true feature importance10.1016/j.jhazmat.2025.137382 ↗
41. Deep feature selection: Theory and application to identify enhancers and promoters10.1089/cmb.2015.0189 ↗
42. Multi-label feature selection based on fuzzy rough sets with metric learning and label enhancement10.1016/j.ijar.2024.109149 ↗
43. LightGBM: A Highly Efficient Gradient Boosting Decision Tree