Stability of Feature Selection in Multi-Omics Data Analysis
Source abstract
Abstract
In the rapidly evolving field of multi-omics data analysis, understanding the stability of feature selection is critical for reliable biomarker discovery and clinical applications. This study investigates the stability of feature-selection methods across various cancer types by utilizing 15 datasets from The Cancer Genome Atlas (TCGA). We employed classifiers with embedded feature selection, including Support Vector Machines (SVM), Logistic Regression (LR), and Lasso regression, each incorporating L1 regularization. Through a comprehensive evaluation using five-fold cross-validation, we measured feature-selection stability and assessed the accuracy of predictions regarding TP53 mutations, a known indicator of poor clinical outcomes in cancer patients. All three classifiers demonstrated optimal feature-selection stability, measured by the Nogueira metric, with higher regularization (fewer selected features), while lower regularization generally resulted in decreased stability across all omics layers. Our findings indicate differences in feature stability across the various omics layers; mirna consistently exhibited the highest stability across classifiers, while the mutation and rna layers were generally less stable, particularly with lower regularization. This work highlights the importance of careful feature selection and validation in high-dimensional datasets to enhance the robustness and reliability of multi-omics analyses.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gene expression and cancer classification · Bioinformatics and Genomic Networks · Genetic Associations and Epidemiology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Computer Science, Bialystok University of Technology, Wiejska 45A, 15-351 Bialystok, Poland
Department of Computer Science, Faculty of Electrical Engineering and Computer Science, Lublin University of Technology, Nadbystrzycka 36B, 20-618 Lublin, Poland
Funding
Lublin University of Technology Scientific Fund
References (51)
Show source-provided references
1. Survey on multi-omics, and multi-omics data analysis, integration and application10.2174/1573412919666230406100948 ↗
2. Subramanian, I., Verma, S., Kumar, S., Jere, A., and Anamika, K. (2020). Multi-omics data integration, interpretation, and its application. Bioinform. Biol. Insights, 14.10.1177/1177932219899051 ↗
3. Prospects and challenges of multi-omics data integration in toxicology10.1007/s00204-020-02656-y ↗
4. Quantitative analysis of culture using millions of digitized books10.1126/science.1199644 ↗
5. Exploring large digital bodies for the study of human behavior10.1007/s40806-023-00363-2 ↗
6. Kęsik, J., Żyła, K., Montusiewicz, J., Miłosz, M., Neamtu, C., and Juszczyk, M. (2022). A methodical approach to 3d scanning of heritage objects being under continuous display. Appl. Sci., 13.10.3390/app13010441 ↗
7. Wang, Z., Jensen, M.A., and Zenklusen, J.C. (2016). A practical guide to the cancer genome atlas (TCGA). Statistical Genomics: Methods and Protocols, Humana Press.10.1007/978-1-4939-3578-9_6 ↗
8. (2024, October 30). NIH, TCGA Program, Available online: https://www.cancer.gov/ccg/research/genome-sequencing/tcga.
9. The international cancer genome consortium data portal10.1038/s41587-019-0055-9 ↗
10. (2024, October 30). ICGC Data Repository. Available online: https://docs.icgc-argo.org/docs/data-access/icgc-25k-data.
11. Discovering and linking public omics data sets using the Omics Discovery Index10.1038/nbt.3790 ↗
12. (2024, October 30). Omics DI Homepage. Available online: https://www.omicsdi.org/.
13. Information security policy creating
14. Kang, M., Ko, E., and Mersha, T.B. (2022). A roadmap for multi-omics data integration using deep learning. Briefings Bioinform., 23.10.1093/bib/bbab454 ↗
15. Artificial intelligence-based multi-omics analysis fuels cancer precision medicine10.1016/j.semcancer.2022.12.009 ↗
16. Chakraborty, S., Sharma, G., Karmakar, S., and Banerjee, S. (2024). Multi-OMICS approaches in cancer biology: New era in cancer therapy. Biochim. Biophys. Acta (BBA)-Mol. Basis Dis., 1870.10.1016/j.bbadis.2024.167120 ↗
17. Alkhateeb, A., and Rueda, L. (2023). Machine Learning Methods for Multi-Omics Data Integration, Springer.10.1007/978-3-031-36502-7 ↗
18. Ahmed, Z., Wan, S., Zhang, F., and Zhong, W. (2024). Artificial intelligence for omics data analysis. BMC Methods, 1.10.1186/s44330-024-00004-5 ↗
19. Wekesa, J.S., and Kimwele, M. (2023). A review of multi-omics data integration through deep learning approaches for disease diagnosis, prognosis, and treatment. Front. Genet., 14.10.3389/fgene.2023.1199087 ↗
20. Leng, D., Zheng, L., Wen, Y., Zhang, Y., Wu, L., Wang, J., Wang, M., Zhang, Z., He, S., and Bo, X. (2022). A benchmark study of deep learning-based multi-omics data fusion methods for cancer. Genome Biol., 23.10.1186/s13059-022-02739-2 ↗
21. Labory, J., and Bottini, S. (2024). The multiomics revolution in the era of deep learning: Allies or enemies. Artificial Intelligence for Medicine, Elsevier.10.1016/B978-0-443-13671-9.00017-X ↗
22. Ensemble feature selection for high-dimensional data: A stability analysis across multiple domains10.1007/s00521-019-04082-3 ↗
23. Importance of feature selection stability in the classifier evaluation on high-dimensional genetic data10.7717/peerj.18405 ↗
24. Li, Y., Mansmann, U., Du, S., and Hornung, R. (2022). Benchmark study of feature selection strategies for multi-omics data. BMC Bioinform., 23.10.1186/s12859-022-04962-x ↗
25. Momeni, Z., Hassanzadeh, E., Abadeh, M.S., and Bellazzi, R. (2020). A survey on single and multi omics data mining methods in cancer data classification. J. Biomed. Inform., 107.10.1016/j.jbi.2020.103466 ↗
26. Approaches to multi-objective feature selection: A systematic literature review10.1109/ACCESS.2020.3007291 ↗
27. Statistics: The exploration and analysis of data
28. Hybrid method based on information gain and support vector machine for gene selection in cancer classification10.1016/j.gpb.2017.08.002 ↗
29. Overcoming the myopia of inductive learning algorithms with RELIEFF10.1023/A:1008280620621 ↗
30. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy10.1109/TPAMI.2005.159 ↗
31. Gene selection for cancer classification using support vector machines10.1023/A:1012487302797 ↗
32. Genetic algorithm-based heuristic for feature selection in credit risk assessment10.1016/j.eswa.2013.09.004 ↗
33. The lasso method for variable selection in the Cox model10.1002/(SICI)1097-0258(19970228)16:4<385::AID-SIM380>3.0.CO;2-3 ↗
34. Random forests10.1023/A:1010933404324 ↗
35. Stability of feature selection algorithm: A review
36. Analysis and comparison of feature selection methods towards performance and stability10.1016/j.eswa.2024.123667 ↗
37. A new definition for feature selection stability analysis10.1007/s10472-024-09936-8 ↗
38. Mohtasham, F., Pourhoseingholi, M., Hashemi Nazari, S.S., Kavousi, K., and Zali, M.R. (2024). Comparative analysis of feature selection techniques for COVID-19 dataset. Sci. Rep., 14.10.1038/s41598-024-69209-6 ↗
39. Hayet-Otero, M., Garcia-Garcia, F., Lee, D.J., Martínez-Minaya, J., España Yandiola, P.P., Urrutia Landa, I., Nieves Ermecheo, M., Quintana, J.M., Menéndez, R., and Torres, A. (2023). Extracting relevant predictive variables for COVID-19 severity prognosis: An exhaustive comparison of feature selection techniques. PLoS ONE, 18.10.1371/journal.pone.0284150 ↗
40. Support-Vector Networks10.1007/BF00994018 ↗
41. Classification with a Reject Option using a Hinge Loss
42. Hosmer, D.W., Lemeshow, S., and Sturdivant, R.X. (2013). Applied Logistic Regression, John Wiley & Sons.10.1002/9781118548387 ↗
43. LASSO regression10.1002/bjs.10895 ↗
44. Saeys, Y., Abeel, T., and Van de Peer, Y. (2008). Robust feature selection using ensemble feature selection techniques. Machine Learning and Knowledge Discovery in Databases, Proceedings of the European Conference, ECML PKDD 2008, Antwerp, Belgium, 15–19 September 2008, Springer. Proceedings, Part II 19.10.1007/978-3-540-87481-2_21 ↗
45. Kuncheva, L. (2007, January 12–14). A stability index for feature selection. Proceedings of the Artificial Intelligence and Applications, AIAP’07, Innsbruck, Austria.
46. Measuring stability of feature selection in biomedical datasets
47. On the stability of feature selection algorithms
48. Herrmann, M., Probst, P., Hornung, R., Jurinovic, V., and Boulesteix, A.L. (2021). Large-scale benchmark study of survival prediction methods using multi-omics data. Briefings Bioinform., 22.10.1093/bib/bbaa167 ↗
49. TP53 mutations, expression and interaction networks in human cancers10.18632/oncotarget.13483 ↗
50. Scikit-learn: Machine Learning in Python
51. Stability of feature selection algorithms: A study on high-dimensional spaces10.1007/s10115-006-0040-8 ↗