journal article·2022-08-27Open access

Application of Machine Learning to Express Measurement Uncertainty

Vladimir Polužanski, Uros Kovacevic, Nebojsa Bacanin, Tarik A. Rashid, Sasa Stojanovic, Bosko Nikolic

Applied Sciences· Volume 12· Issue 17

Abstract

The continuing increase in data processing power in modern devices and the availability of a vast amount of data via the internet and the internet of things (sensors, monitoring systems, financial records, health records, social media, etc.) enabled the accelerated development of machine learning techniques. However, the collected data can be inconsistent, incomplete, and noisy, leading to a decreased confidence in data analysis. The paper proposes a novel “judgmental” approach to evaluating the measurement uncertainty of the machine learning model that implements the dropout additive regression trees algorithm. The considered method uses the procedure for expressing the type B measurement uncertainty and the maximal value of the empirical absolute loss function of the model. It is related to the testing and monitoring of power equipment and determining partial discharge location by the non-iterative, all-acoustic method. The example uses the dataset representing the correlation of the mean distance of partial discharge and acoustic sensors and the temperature coefficient of the sensitivity of the non-iterative algorithm. The dropout additive regression trees algorithm achieved the best performance based on the highest coefficient of determination value. Most of the model’s predictions (>97%) fell into the proposed standard measurement uncertainty interval for both “seen” and “unseen” data.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Data and IoT Technologies · Non-Destructive Testing Techniques · Water Quality Monitoring Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electrical Engineering, University of Belgrade, 73 Kralja Aleksandra Boulevard, 11120 Belgrade, Serbia

Electrical Engineering Institute of Nikola Tesla, University of Belgrade, 8a Koste Glavinica Street, 11040 Belgrade, Serbia

Faculty of Mechanical Engineering, University of Belgrade, 16 Kraljice Marije Street, 11120 Belgrade, Serbia

Department of Informatics and Computing, Singidunum University, 32 Danijelova Street, 11000 Belgrade, Serbia

Computer Science and Engineering Department, University of Kurdistan Hewler, 30m Avenue, Erbil 44001, Kurdistan Region, Iraq

Funding

Science Fund of the Republic of Serbia

References (40)

Show source-provided references
1. Russell, S., and Norvig, P. (2010). Artificial Intelligence: A Modern Approach, Prentice Hall. [3rd ed.].
2. Advances in Machine Learning and Deep Neural Networks10.1109/JPROC.2021.3072172 ↗
3. Securing Critical Infrastructures: Deep-Learning-Based Threat Detection in IIoT10.1109/MCOM.101.2001126 ↗
4. Machine Learning10.1109/MS.2016.114 ↗
5. A Critical Review of Practices and Challenges in Intrusion Detection Systems for IoT: Toward Universal and Resilient Systems10.1109/COMST.2018.2844742 ↗
6. Shinde, P.P., and Shah, S. (2018, January 16–18). A Review of Machine Learning and Deep Learning Applications. Proceedings of the 4th International Conference on Computing, Communication Control and Automation (ICCUBEA), Pune, India.10.1109/ICCUBEA.2018.8697857 ↗
7. An overview of security and privacy in smart cities’ IoT communications10.1002/ett.3677 ↗
8. Ahmed, M., Cox, D., Simpson, B., and Aloufi, A. (2022). ECU-IoFT: A Dataset for Analysing Cyber-Attacks on Internet of Flying Things. Appl. Sci., 12.10.3390/app12041990 ↗
9. Fagbola, F.I., and Venter, H.S. (2022). Smart Digital Forensic Readiness Model for Shadow IoT Devices. Appl. Sci., 12.10.3390/app12020730 ↗
10. Ashfaq, Z., Mumtaz, R., Rafay, A., Zaidi, S.M.H., Saleem, H., Mumtaz, S., Shahid, A., De Poorter, E., and Moerman, I. (2022). Embedded AI-Based Digi-Healthcare. Appl. Sci., 12.10.3390/app12010519 ↗
11. Applications of ML/DL in the management of smart cities and societies based on new trends in information technologies: A systematic literature review10.1016/j.scs.2022.104089 ↗
12. The COVID-19 epidemic analysis and diagnosis using deep learning: A systematic literature review and future directions10.1016/j.compbiomed.2021.105141 ↗
13. Applications of Artificial Intelligence and Machine learning in smart cities10.1016/j.comcom.2020.02.069 ↗
14. Uncertainty in big data analytics: Survey, opportunities and challenges10.1186/s40537-019-0206-3 ↗
15. Machine Learning: Algorithms, Real-World Applications and Research Directions10.1007/s42979-021-00592-x ↗
16. Shende, M.K., Salih, S.Q., Bokde, N.D., Scholz, M., Oudah, A.Y., and Yaseen, Z.M. (2022). Natural Time Series Parameters Forecasting: Validation of the Pattern-Sequence-Based Forecasting (PSF) Algorithm; A New Python Package. Appl. Sci., 12.10.3390/app12126194 ↗
17. Siddique, T., Mahmud, M.S., Keesee, A.M., Ngwira, C.M., and Connor, H. (2022). A Survey of Uncertainty Quantification in Machine Learning for Space Weather Prediction. Geosciences, 12.10.3390/geosciences12010027 ↗
18. Defining Uncertainty: A Conceptual Basis for Uncertainty Management in Model-Based Decision Support10.1076/iaij.4.1.5.16466 ↗
19. Siddique, T., and Mahmud, M.S. (2021, January 1–2). Classification of fNIRS Data Under Uncertainty: A Bayesian Neural Network Approach. Proceedings of the IEEE International Conference on E-health Networking, Application & Services (HEALTHCOM), Shenzhen, China.10.1109/HEALTHCOM49281.2021.9398971 ↗
20. Uncertainty in integrated assessment modelling10.1023/A:1015783803445 ↗
21. Meaningful expression of uncertainty in measurement10.1007/s00769-021-01485-5 ↗
22. Optimal performance of hybrid energy system in the presence of electrical and heat storage systems under uncertainties using stochastic p-robust optimization technique10.1016/j.scs.2022.103935 ↗
23. Community decision-makers’ choice of multi-objective scheduling strategy for integrated energy considering multiple uncertainties and demand response10.1016/j.scs.2022.103945 ↗
24. Many-objective charging optimization for electric vehicles considering demand response and multi-uncertainties based on Markov chain and information gap decision theory10.1016/j.scs.2021.103652 ↗
25. The importance of uncertainty quantification in model reproducibility10.1098/rsta.2020.0071 ↗
26. Levi, D., Gispan, L., Giladi, N., and Fetaya, E. (2022). Evaluating and Calibrating Uncertainty Prediction in Regression Tasks. Sensors, 22.10.3390/s22155540 ↗
27. Towards Knowledge Uncertainty Estimation for Open Set Recognition10.3390/make2040028 ↗
28. Fotis, G., Vita, V., and Ekonomou, L. (2022). Machine Learning Techniques for the Prediction of the Magnetic and Electric Field of Electrostatic Discharges. Electronics, 11.10.3390/electronics11121858 ↗
29. Fotis, G., Vita, V., and Maris, T.I. (2022). Rise Time and Peak Current Measurement of ESD Current from Air Discharges with Uncertainty Calculation. Electronics, 11.10.3390/electronics11162507 ↗
30. Polužanski, V., Kartalović, N., and Nikolić, B. (2021). Impact of Power Transformer Oil-Temperature on the Measurement Uncertainty of All-Acoustic Non-Iterative Partial Discharge Location. Materials, 14.10.3390/ma14061385 ↗
31. Besharatifard, H., Hasanzadeh, S., Heydarian-Forushani, E., Alhelou, H.H., and Siano, P. (2022). Detection and Analysis of Partial Discharges in Oil-Immersed Power Transformers Using Low-Cost Acoustic Sensors. Appl. Sci., 12.10.3390/app12063010 ↗
32. ISO (2008). Guide to the Expression of Uncertainty in Measuremen, ISO.
33. European Accreditation (2013). EA-4/02 M (2013): Evaluation of the Uncertainty of Measurement in Calibration, European Accreditation.
34. Singapore Accreditation Council (2019). Guidance Notes EL 001: Guidelines on the Evaluation and Expression of Measurement Uncertainty for Electrical Testing Field.
35. Shalev-Shwartz, S., and Wexler, Y. (2016). Minimizing the Maximal Loss: How and Why?. arXiv.
36. A Comprehensive Survey of Loss Functions in Machine Learning10.1007/s40745-020-00253-5 ↗
37. The coefficient of determination R-squared is more informative than SMAPE, MAE, MAPE, MSE and RMSE in regression analysis evaluation10.7717/peerj-cs.623 ↗
38. Multiple additive regression trees with application in epidemiology10.1002/sim.1501 ↗
39. Rashmi, K.V., and Gilad-Bachrach, R. (2015). DART: Dropouts meet Multiple Additive Regression Trees. arXiv.
40. Ahmed, Z., Amizadeh, S., Bilenko, M., Carr, R., Chin, W.-S., Dekel, Y., Dupre, X., Eskarveskiy, V., Filipi, S., and Finley, T. (2019, January 4–8). Machine learning at microsoft with ML.Net. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Anchorage, AK, USA.10.1145/3292500.3330667 ↗