Using Kernel Density Estimation in Knowledge Distillation to Construct the Prediction Model for Bipolar Disorder Patients
Source abstract
Abstract
Bipolar disorder is a severe mood disorder and is one of the top 20 causes of disability in the world. Although there have been numerous studies based on machine learning models for the detection of bipolar disorder patients, these works have limitations. This study used a kernel density estimation algorithm to generate distributions of the input data, which can make knowledge distillation work and can improve prediction performances of the machine learning models for bipolar disorder. To the best of our knowledge, this is the first attempt to apply kernel density estimation to knowledge distillation. Another main contribution is that we used medical history information that was readily available from the electronic health record system, trying to improve the limitation of previous studies that needed to use special instruments to collect input data. Furthermore, in view of the fact that most previous studies have sample sizes of less than 1000, we collected tens of thousands of data samples to improve the representativeness of the constructed prediction models. Finally, the generated data distributions helped the decision tree algorithm to select the appropriate branching attributes to construct the prediction models. These branching attributes can be mapped back to specific diseases that are all associated with bipolar disorder.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Bipolar Disorder and Treatment
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Information Engineering, National Kaohsiung University of Science and Technology, Kaohsiung City 82445, Taiwan
References (40)
Show source-provided references
1. Bipolar disorder10.1136/bmj.e8508 ↗
2. Association, A.P. (2013). Diagnostic and Statistical Manual of Mental Disorders: DSM-5, American Psychiatric Publishing. [5th ed.].
3. Bipolar disorder10.1016/S0140-6736(15)00241-X ↗
4. The impact of environmental factors in severe psychiatric disorders10.3389/fnins.2014.00019 ↗
5. Bipolar Disorder10.1056/NEJMra1906193 ↗
6. The Role of Machine Learning in Diagnosing Bipolar Disorder: Scoping Review10.2196/29749 ↗
7. Classification of unipolar and bipolar depression using machine learning techniques10.1016/j.psychres.2020.113624 ↗
8. Individualized Prediction and Clinical Staging of Bipolar Disorders using Neuroanatomical Biomarkers
9. White Matter Microstructure in Pediatric Bipolar Disorder and Disruptive Mood Dysregulation Disorder10.1016/j.jaac.2019.05.035 ↗
10. An intelligent System for Diagnosis of Schizophrenia and Bipolar Diseases using Support Vector Machine with Different Kernels
11. Korattikara Balan, A., Rathod, V., Murphy, K.P., and Welling, M. (2015, January 7–12). Bayesian dark knowledge. Proceedings of the Conference on Neural Information Processing Systems, Montreal, QC, Canada.
12. Ba, J., and Caruana, R. (2018, January 8–13). Do Deep Nets Really Need to be Deep?. Proceedings of the Conference on Neural Information Processing Systems, Montreal, QC, Canada.
13. Hinton, G., Vinyals, O., and Dean, J. (2023, January 7–12). Distilling the Knowledge in a Neural Network. Proceedings of the Conference on Neural Information Processing Systems, Deep Learning and Representation Learning Workshop, Montreal, QC, Canada.
14. On Estimation of a Probability Density Function and Mode10.1214/aoms/1177704472 ↗
15. Remarks on Some Nonparametric Estimates of a Density Function10.1214/aoms/1177728190 ↗
16. Role of Data Analytics in Infrastructure Asset Management: Overcoming Data Size and Quality Problems10.1061/JPEODX.0000175 ↗
17. MIMIC-III, a freely accessible critical care database10.1038/sdata.2016.35 ↗
18. Jurafsky, D., Martin, J.H., Kehler, A., Linden, K.V., and Ward, N. (2000). Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics and Speech Recognition, Prentice Hall. [1st ed.].
19. Mikolov, T., Sutskever, I., Chen, K., Corrado, G., and Dean, J. (2013, January 5–10). Distributed representations of words and phrases and their compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA. Volume 2.
20. Mikolov, T., Chen, K., Corrado, G.s., and Dean, J. (May, January 30). Efficient Estimation of Word Representations in Vector Space. Proceedings of the Workshop at International Conference on Learning Representations, Vancouver, BC, Canada.
21. Support-vector networks10.1007/BF00994018 ↗
22. Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992, January 27–29). A training algorithm for optimal margin classifiers. Proceedings of the Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, PA, USA.10.1145/130385.130401 ↗
23. Winterfeldt, D.V., and Edwards, W. (1986). Decision Analysis and Behavioral Research, Cambridge University Press. [1st ed.].
24. Simplifying decision trees10.1016/S0020-7373(87)80053-6 ↗
25. Artificial neural networks: A tutorial10.1109/2.485891 ↗
26. Deep learning10.1038/nature14539 ↗
27. Hastie, T., Tibshirani, R., and Friedman, J. (2003). The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer.
28. A Brief Survey of Bandwidth Selection for Density Estimation10.1080/01621459.1996.10476701 ↗
29. Oyang, Y.-J., Ou, Y.-Y., Hwang, S.-C., Chen, C.-Y., and Chang, T.-H. (August, January 31). Data classification with a relaxed model of variable kernel density estimation. Proceedings of the IEEE International Joint Conference on Neural Networks, Montreal, QC, Canada. Volume 2835.
30. Data classification with radial basis function networks based on a novel kernel density estimation algorithm10.1109/TNN.2004.836229 ↗
31. Yang, C.-C. (2019). Kernel Density Based Probability Estimation for Data Classifiers. [Master’s Thesis, National Taiwan University].
32. Liu, R.-J. (2022). A Study on Optimal Bandwidth Settings for Adaptive Kernel Density Estimation. [Master’s Thesis, National Taiwan University].
33. Clinical characterization of patients with bipolar disorder and a history of asthma: An exploratory study10.1016/j.jpsychires.2023.05.061 ↗
34. Bipolar disorders: A review
35. Physical-mental multimorbidity in a large primary health care population in Stockholm County, Sweden10.1016/j.ajp.2022.103354 ↗
36. Role of the Gut-Brain Axis in the Shared Genetic Etiology Between Gastrointestinal Tract Diseases and Psychiatric Disorders: A Genome-Wide Pleiotropic Analysis10.1001/jamapsychiatry.2022.4974 ↗
37. Epidemiologic characteristics and risk factors in patients with ketamine-associated lower urinary tract symptoms accompanied by urinary tract infection: A cross-sectional study10.1097/MD.0000000000015943 ↗
38. Reduced cerebrovascular reactivity among adolescents with bipolar disorder10.1111/bdi.12719 ↗
39. Incidence of Parkinson’s disease, dementia, cerebrovascular disease and stroke in bipolar disorder compared to other psychiatric disorders: An electronic health records network study of 66 million people10.1111/bdi.13022 ↗
40. Bipolar Spectrum Disorder May Be Associated With Family History of Diseases10.14740/jocmr4143 ↗