journal article·2026-04-17Open access

A Comprehensive Benchmark of Machine Learning Methods for Blood Glucose Prediction in Type 1 Diabetes: A Multi-Dataset Evaluation

Mikhail Kolev, Irina Naskinova, Mariyan Milev, Stanislava Stoilova, Iveta Nikolova

Applied Sciences· Volume 16· Issue 8

Abstract

Managing blood glucose in type 1 diabetes (T1D) remains a daily clinical challenge, and accurate short-term prediction of glucose levels can meaningfully improve insulin dosing decisions while reducing the risk of dangerous hypoglycaemic episodes. Although numerous machine learning approaches have been proposed for this task, comparing their relative merits is difficult because published studies differ widely in datasets, preprocessing choices, and evaluation criteria. In this work, we address this research gap by benchmarking ten machine learning methods—from a naïve persistence baseline through classical linear regressors, gradient-boosted ensembles, and recurrent neural networks to a novel hybrid that couples LightGBM with stochastic differential equation (SDE)-based glucose–insulin simulation—on two multi-patient datasets comprising 34 T1D subjects, across prediction horizons of 15, 30, 60, and 120 min. Every method is trained and tested under identical preprocessing and temporal splitting conditions to ensure a fair comparison. The proposed Hybrid LightGBM-SDE model consistently outperforms all alternatives, recording RMSE values of 22.42 mg/dL at 15 min, 28.74 mg/dL at 30 min, 33.89 mg/dL at 60 min, and 37.22 mg/dL at 120 min—an improvement of between 13.6% and 27.0% relative to standalone LightGBM. At the clinically important 30 min horizon, 99.7% of predictions lie within the acceptable A and B zones of the Clarke Error Grid. Wilcoxon signed-rank tests confirm that performance differences are statistically significant (p < 10−10), and SHAP-based analysis shows that the SDE-derived simulation features are among the most influential predictors, especially at longer horizons. All source code and evaluation scripts are publicly released to support reproducibility. Due to temporary data access constraints, all experiments reported here use physics-based synthetic datasets generated from the Bergman minimal model, replicating the structural properties of the D1NAMO and HUPA-UCM collections; validation on the original clinical recordings is planned. Among the two synthetic datasets, the D1NAMO-equivalent cohort (nine patients) proves more challenging, with systematically higher per-patient RMSE variance. The clinically acceptable prediction accuracy at the 30 min horizon (99.7% in Clarke zones A + B) suggests potential for integration into insulin dosing decision-support systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Diabetes Management and Research · Hyperglycemia and glycemic control in critically ill and hospitalized patients · Pancreatic function and diabetes

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mathematics, University of Architecture, Civil Engineering and Geodesy, 1 Hristo Smirnenski Blvd., 1164 Sofia, Bulgaria

Department of Applied Computer Science and Mathematical Modelling, Faculty of Mathematics and Computer Science, University of Warmia and Mazury in Olsztyn, 10-719 Olsztyn, Poland

Department of Statistics and Econometrics, Faculty of Economics and Business Administration, Sofia University St. Kliment Ohridski, 125 Tsarigradsko Shosse Blvd., bl. 3, 1113 Sofia, Bulgaria

Funding

Significance and Potential Risks of Artificial Intelligence for Healthcare

References (30)

Show source-provided references
1. Global incidence, prevalence, and mortality of type 1 diabetes in 2021 with projection to 2040: A modelling study10.1016/S2213-8587(22)00218-2 ↗
2. Clinical targets for continuous glucose monitoring data interpretation: Recommendations from the international consensus on time in range10.2337/dci19-0028 ↗
3. A review of personalized blood glucose prediction strategies for T1DM patients10.1002/cnm.2833 ↗
4. Data-driven modeling and prediction of blood glucose dynamics: Machine learning applications in type 1 diabetes10.1016/j.artmed.2019.07.007 ↗
5. Benchmarking machine learning algorithms on blood glucose prediction for type I diabetes in comparison with classical time-series models10.1109/TBME.2020.2975959 ↗
6. Quantitative estimation of insulin sensitivity
7. Evaluating clinical accuracy of systems for self-monitoring of blood glucose10.2337/diacare.10.5.622 ↗
8. Glucose concentration can be predicted ahead in time from continuous glucose monitoring sensor time-series10.1109/TBME.2006.889774 ↗
9. Multivariate prediction of subcutaneous glucose concentration in type 1 diabetes patients based on support vector regression10.1109/TITB.2012.2219876 ↗
10. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A scalable tree boosting system. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
11. Ke, G., Meng, Q., Finley, T., Wang, T., Chen, W., Ma, W., Ye, Q., and Liu, T.-Y. (2017, January 4–9). LightGBM: A highly efficient gradient boosting decision tree. Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA. Available online: https://proceedings.neurips.cc/paper/6907-lightgbm-a-highly-efficient-gradient-boosting-decision-tree.
12. GluNet: A deep learning framework for accurate glucose forecasting10.1109/JBHI.2019.2931842 ↗
13. Sun, Q., Jankovic, M.V., Bally, L., and Mougiakakou, S.G. (2018, January 20–22). Predicting blood glucose with an LSTM and Bi-LSTM based deep neural network. Proceedings of the 14th Symposium on Neural Networks and Applications (NEUREL), Belgrade, Serbia.10.1109/NEUREL.2018.8586990 ↗
14. Blood glucose prediction with variance estimation using recurrent neural networks10.1007/s41666-019-00059-y ↗
15. The UVA/PADOVA type 1 diabetes simulator: New features10.1177/1932296813514502 ↗
16. Grey-box modelling of pharmacokinetic/pharmacodynamic systems10.1007/s10928-004-8323-8 ↗
17. Deep learning for diabetes: A systematic review10.1109/JBHI.2020.3040225 ↗
18. The open D1NAMO dataset: A multi-modal dataset for research on non-invasive type 1 diabetes management10.1016/j.imu.2018.09.003 ↗
19. HUPA-UCM Diabetes Dataset10.1016/j.dib.2024.110559 ↗
20. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
21. Cho, K., van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning phrase representations using RNN encoder-decoder for statistical machine translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1179 ↗
22. Lundberg, S.M., and Lee, S.I. (2017, January 4–9). A unified approach to interpreting model predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA. Available online: https://proceedings.neurips.cc/paper/7062-a-unified-approach-to-interpreting-model-predictions.
23. Grinsztajn, L., Oyallon, E., and Varoquaux, G. (December, January 28). Why do tree-based models still outperform deep learning on typical tabular data?. Proceedings of the 36th International Conference on Neural Information Processing Systems (NeurIPS), New Orleans, LA, USA. Available online: https://proceedings.neurips.cc/paper_files/paper/2022/hash/0378c7692da36807bdec87ab043cdadc-Abstract-Datasets_and_Benchmarks.html.
24. Arik, S.Ö., and Pfister, T. (2021, January 2–9). TabNet: Attentive interpretable tabular learning. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i8.16826 ↗
25. Gorishniy, Y., Rubachev, I., Khrulkov, V., and Babenko, A. (2021, January 6–14). Revisiting deep learning models for tabular data. Proceedings of the 35th International Conference on Neural Information Processing Systems (NeurIPS), Virtual. Available online: https://proceedings.neurips.cc/paper/2021/hash/9d86d83f925f2149e9edb0ac3b49229c-Abstract.html.
26. Huang, X., Khetan, A., Cvitkovic, M., and Karnin, Z. (2020). TabTransformer: Tabular data modeling using contextual embeddings. arXiv.
27. U.S. Food and Drug Administration (2026, March 20). Artificial Intelligence/Machine Learning (AI/ML)-Based Software as a Medical Device (SaMD) Action Plan, Available online: https://www.fda.gov/media/145022/download.
28. Mitev, P. (2025). Development of a System for Flexible Feeding of Parts with Robot and Machine Vision. Eng. Proc., 104.10.3390/engproc2025104084 ↗
29. Development of a system for automatic feeding and orientation of cylindrical parts
30. Mitev, P., Tashev, A., and Stoyanov, Y. (2025). Design and Construction of an Engine Oil Viscosity Meter with Electronic Control. Eng. Proc., 100.10.3390/engproc2025100055 ↗