Ensuring Data Accuracy, Completeness, and Interpretation in Advanced Manufacturing
Source abstract
Abstract
Advanced manufacturing is undergoing a profound transformation, with data quickly becoming its most strategic asset. The industry is pushing toward Industry 4.0 with its sights already on the human-centric Industry 5.0. Manufacturing firms are rapidly integrating AI, IoT, and advanced analytics to enable real-time decision making, predictive maintenance, and full manufacturing lifecycle optimization. However, this data-driven revolution exposes a critical vulnerability: the hidden direct costs and cascading downstream consequences of inaccurate, missing, or corrupt data. This paper provides an in-depth examination of the data quality crisis facing modern manufacturing, exploring its quantifiable impact on cost, safety, and strategic decision making; and identifies the tangible barriers preventing scalable AI in manufacturing today. We investigate how bad data undermines the digital thread, erodes both operational and strategic trust, and stalls the transition to autonomous systems. Supported by recent industry surveys, academic findings, and leading trends, we reveal that most manufacturers suffer from systemic data quality issues, with billions lost annually to inefficiencies, rework, and flawed decisions. Addressing this, the paper evaluates state-of-the-art solutions for real-time data validation, anomaly detection, and predictive imputation. Building upon this, we identify key gaps—including the lack of unified data quality frameworks, integration across legacy/modern systems, and actionable imputation under uncertainty—and propose a roadmap to bridge them. The paper concludes by outlining four research directions that support a seamless, scalable transition toward a trustworthy data foundation in manufacturing. Industry 4.0/5.0 is defined by data, insight, and actionable intelligence: only manufacturers that tame their data chaos will thrive.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Quality and Management · Digital Transformation in Industry · Big Data and Business Intelligence
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
AI in Manufacturing, Aerospace Engineering, Delft University of Technology, Kluyverweg 1, 2629 HS Delft, The Netherlands
Aerospace Engineering, Delft University of Technology, Kluyverweg 1, 2629 HS Delft, The Netherlands
References (100+)
Show source-provided references
1. Advanced Data Collection and Analysis in Data-Driven Manufacturing Process10.1186/s10033-020-00459-x ↗
2. Hu, C., Sun, Z., Li, C., Zhang, Y., and Xing, C. (2023). Survey of Time Series Data Generation in IoT. Sensors, 23.10.3390/s23156976 ↗
3. Sharp, M. (2025, December 30). NIST Explores AI-Enhanced Monitoring in Manufacturing Processes. NIST, Available online: https://www.nist.gov/blogs/manufacturing-innovation-blog/nist-explores-ai-enhanced-monitoring-manufacturing-processes.
4. Big data/analytics platform for Industry 4.0 implementation in advanced manufacturing context10.1007/s00170-021-07834-5 ↗
5. Eskue, N. (2023). Digital Thread Roadmap for Manufacturing and Health Monitoring the Life Cycle of Composite Aerospace Components. Aerospace, 10.10.3390/aerospace10020146 ↗
6. Byabazaire, J., O’Hare, G., and Delaney, D. (2020, January 3–6). Using Trust as a Measure to Derive Data Quality in Data Shared IoT Deployments. Proceedings of the 2020 29th International Conference on Computer Communications and Networks (ICCCN), Honolulu, HI, USA.10.1109/ICCCN49398.2020.9209633 ↗
7. Key ingredients for evaluating Industry 4.0 readiness for organizations: A literature review10.1108/BIJ-09-2018-0284 ↗
8. Labovitz, G.H., Chang, Y.S., and Rosansky, V. (1993). Making Quality Work: A Leadership Guide for the Results-Driven Manager, Harper Business.
9. Khang, A., Rath, K.C., Satapathy, S.K., Kumar, A., Das, S.R., and Panda, M.R. (2023). Enabling the Future of Manufacturing: Integration of Robotics and IoT to Smart Factory Infrastructure in Industry 4.0. Handbook of Research on AI-Based Technologies and Applications in the Era of the Metaverse, IGI Global Scientific Publishing.10.4018/978-1-6684-8851-5.ch002 ↗
10. Industrial Internet of Things Intelligence Empowering Smart Manufacturing: A Literature Review10.1109/JIOT.2024.3367692 ↗
11. Internet of things (IoT) and big data analytics (BDA) for digital manufacturing (DM)10.1080/00207543.2021.1953181 ↗
12. Big data analytics for intelligent manufacturing systems: A review10.1016/j.jmsy.2021.03.005 ↗
13. Bejani, M., Appello, D., Mauri, M., Todaro, S., and Mariani, S. (2025, January 26–30). AI-Assisted Framework for Real-Time Monitoring and Management of Probe Cards in Electrical Wafer Sort Applications. Proceedings of the 2025 IEEE European Test Symposium (ETS), Tallinn, Estonia.
14. Statistical process monitoring of a multiphase flow facility10.1016/j.conengprac.2015.04.012 ↗
15. Singh, H.A., and Almangour, B.P. (2023). Handbook of Smart Manufacturing: Forecasting the Future of Industry 4.0, CRC Press.
16. The intelligent industry of the future: A survey on emerging trends, research challenges and opportunities in Industry 4.010.3233/AIS-170432 ↗
17. (2025, December 11). A Conceptual Framework to Liberate Open Data from Dark Data—ProQuest. Available online: https://www.proquest.com/openview/9a2b8a1f8a0c360d458c0e4337a2e3c0/1?pq-origsite=gscholar&cbl=2026366&diss=y.
18. Big Data Pipelines on the Computing Continuum: Tapping the Dark Data10.1109/MC.2022.3154148 ↗
19. Understanding and Defining Dark Data for the Manufacturing Industry10.1109/TEM.2021.3051981 ↗
20. Williamson, S.M., and Prybutok, V. (2024). Balancing Privacy and Progress: A Review of Privacy Challenges, Systemic Oversight, and Patient Perceptions in AI-Driven Healthcare. Appl. Sci., 14.10.3390/app14020675 ↗
21. Exploring big data-driven innovation in the manufacturing sector: Evidence from UK firms10.1007/s10479-021-04077-1 ↗
22. A data-oriented shopfloor management in the production context: A systematic literature review10.1007/s00170-024-14238-8 ↗
23. Corban, T. (2026, February 18). Data as a Strategic Asset. EBSCOhost. Available online: https://openurl.ebsco.com/contentitem/gcd:149599922?sid=ebsco:plink:crawler&id=ebsco:gcd:149599922.
24. Bejani, M., Appello, D., Mauri, M., Missaglia, E., and Mariani, S. (2025, January 6–9). Digital Twin-Assisted Optimal Sensor Placement for Real-Time Monitoring of Probe Cards in EWS Applications. Proceedings of the 2025 26th International Conference on Thermal, Mechanical and Multi-Physics Simulation and Experiments in Microelectronics and Microsystems (EuroSimE), Utrecht, The Netherlands.10.1109/EuroSimE65125.2025.11006625 ↗
25. AI-Powered Innovations in Contemporary Manufacturing Procedures: An Extensive Analysis
26. Selecting advanced analytics in manufacturing: A decision support model10.1080/09537287.2022.2126951 ↗
27. Advancing Manufacturing Through Artificial Intelligence: Current Landscape, Perspectives, Best Practices, Challenges, and Future Direction10.1109/ACCESS.2024.3458830 ↗
28. Improving operations through a lean AI paradigm: A view to an AI-aided lean manufacturing via versatile convolutional neural network10.1007/s00170-024-13874-4 ↗
29. Damtew, A.W. (2024). Application of Digital Thread Impacts on Sustainable Manufacturing and Smart Production Systems. Res. Sq., preprint.10.21203/rs.3.rs-3993008/v1 ↗
30. Advanced Manufacturing in Industry 5.0: A Survey of Key Enabling Technologies and Future Trends10.1109/TII.2023.3274224 ↗
31. (2025, December 12). Data Challenges Affect Nearly all Manufacturers, Aerospace Manufacturing and Design, Available online: https://www.aerospacemanufacturinganddesign.com/article/data-challenges-affect-nearly-all-manufacturers.
32. (2025, December 12). New SoftServe Study: Big Decisions Made with Bad Data. Available online: https://www.softserveinc.com/en-us/news/bad-data-makes-bad-decisions.
33. A Review on Enhancing Data Quality for Optimal Data Analytics Performance
34. (2025, December 12). Data Governance in Manufacturing: Your Complete 2024 Guide. Available online: https://atlan.com/data-governance-in-manufacturing/.
35. (2025, December 12). How Scrap Rework Affect Cost of Quality and OEE. Available online: https://www.ease.io/blog/scrap-rework-affect-cost-of-quality-and-oee/.
36. KashTech LLC (2025, December 12). The Cost of Poor Data Quality and How It Impacts Manufacturing 4.0. Available online: https://www.kashtechllc.com/blog/data-analytics/the-cost-of-poor-data-quality-and-how-it-impacts-manufacturing-4-0/.
37. A survey on missing data in machine learning10.1186/s40537-021-00516-9 ↗
38. (2025, December 12). Improving AI Data Quality in Manufacturing|McKinsey. Available online: https://www.mckinsey.com/capabilities/tech-and-ai/our-insights/clearing-data-quality-roadblocks-unlocking-ai-in-manufacturing.
39. Why AI Projects Fail: Lessons from New Product Development
40. Industrial alarm systems: Challenges and opportunities10.1016/j.jlp.2017.09.001 ↗
41. Ageing workforce management in manufacturing systems: State of the art and future research agenda10.1080/00207543.2019.1600759 ↗
42. Jennex, M., Durcikova, A., Ilvonen, I., and Babb, J. (2024, January 3–6). Assessing and Mitigating the Risk of Critical Knowledge Loss in Organizations: Insights from COVID-19 and the Great Resignation. Proceedings of the Hawaii International Conference on System Sciences 2024 (HICSS-57), Honolulu, HI, USA.10.24251/HICSS.2024.663 ↗
43. Harvesting tacit knowledge for composites workforce development10.1016/j.compositesa.2024.108357 ↗
44. Krumsiek, K.J. (2024). Retention of Knowledge From “Baby Boomers” Prior to Leaving the Workforce. Effective Human Resources Management in the Multigenerational Workplace, IGI Global Scientific Publishing.10.4018/979-8-3693-2173-7.ch002 ↗
45. Because Work is Changing: A New Paradigm for Intergenerational Workplace Knowledge Sharing
46. (2025, December 11). Closing the Manufacturing Skills Gap: Generative AI as a Workforce Solution. Available online: https://www.automate.org/ai/industry-insights/genai-can-help-close-skills-gap.
47. Does data analytics use improve firm decision making quality? The role of knowledge sharing and data analytics competency10.1016/j.dss.2019.03.004 ↗
48. Whig, P., Madavarapu, J.B., Yathiraju, N., and Thatikonda, R. (2024). Managing Knowledge in the Era of Industry 4.0. Knowledge Management and Industry Revolution 4.0., John Wiley & Sons, Ltd.10.1002/9781394242641.ch9 ↗
49. Peixoto, T., Oliveira, B., Oliveira, Ó., and Ribeiro, F. (2025). Data Quality Assessment in Smart Manufacturing: A Review. Systems, 13.10.3390/systems13040243 ↗
50. Qian, H., Wang, M., Zhu, M., and Wang, H. (2025). A Review of Multi-Sensor Fusion in Autonomous Driving. Sensors, 25.10.3390/s25196033 ↗
51. A Systematic Review of Multi-Sensor Information Fusion for Equipment Fault Diagnosis
52. Physics-based and data-driven hybrid modeling in manufacturing: A review
53. Sensor Fusion and Virtual Sensor Design for Enhanced Multi-Sensor Data Accuracy in Autonomous Systems
54. Krempl, G., Puolamäki, K., and Miliou, I. (2025). Advances in Intelligent Data Analysis XXIII: 23rd International Symposium on Intelligent Data Analysis, IDA 2025, Konstanz, Germany, May 7–9, 2025, Proceedings, Springer Nature.10.1007/978-3-031-91398-3 ↗
55. Physics-Informed Neural Networks for robust thermal comfort prediction: Overcoming data quality limitations through physiological constraints10.1016/j.buildenv.2025.113588 ↗
56. A Review of Deep Learning-Based Anomaly Detection Strategies in Industry 4.0 Focused on Application Fields, Sensing Equipment, and Algorithms10.1109/ACCESS.2024.3424488 ↗
57. Badioze Zaman, H., Robinson, P., Smeaton, A.F., Shih, T.K., Jørgensen, B.N., Huajing, Z., Xiaoping, L., Mohamad Ali, N., and Mat Surin, E.S. (2026). Data Quality Assessment Framework for Predictive Maintenance (PdM) in Industrial AI: Review. Advances in Visual Informatics, Springer Nature.10.1007/978-981-95-3808-9 ↗
58. Real-Time Adaptive Anomaly Detection in Industrial IoT Environments10.1109/TNSM.2024.3447532 ↗
59. On the Data Quality and Imbalance in Machine Learning-based Design and Manufacturing—A Systematic Review10.1016/j.eng.2024.04.024 ↗
60. Shamsa, M., and Lerner, D. (2024, January 14–18). Defect Mechanisms Responsible for Silent Data Errors. Proceedings of the 2024 IEEE International Reliability Physics Symposium (IRPS), Grapevine, TX, USA.10.1109/IRPS48228.2024.10529392 ↗
61. A framework for anomaly classification in Industrial Internet of Things systems10.1016/j.iot.2024.101446 ↗
62. Dam safety monitoring data anomaly recognition using multiple-point model with local outlier factor10.1016/j.autcon.2024.105290 ↗
63. Pemula, L., Zhang, D., and Dabeer, O. (2025, January 11–15). Robust AD: A Real World Benchmark Dataset for Robustness in Industrial Anomaly Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Nashville, TN, USA.10.1109/CVPRW67362.2025.00389 ↗
64. Oakland, J., and Oakland, R. (2024). Statistical Process Control and Data Analytics, Routledge. [8th ed.].10.4324/9781003439080 ↗
65. Lee, Y., Park, C., Kim, N., Ahn, J., and Jeong, J. (2024). LSTM-Autoencoder Based Anomaly Detection Using Vibration Data of Wind Turbines. Sensors, 24.10.3390/s24092833 ↗
66. Chang, Z., Wu, J., Liang, H., Wang, Y., Wang, Y., and Xiong, X. (2024). A Review of Power System False Data Attack Detection Technology Based on Big Data. Information, 15.10.3390/info15080439 ↗
67. Privacy-preserving federated learning for detecting false data injection attacks on power system10.1016/j.epsr.2024.110150 ↗
68. Smart Frequency Control of Cyber-Physical Power System Under False Data Injection Attacks10.1109/TCSI.2024.3396703 ↗
69. Miguel, P., and Massimo, V. (2020, January 7–11). Towards Trusted Data on Decentralized IoT Applications: Integrating Blockchain in Constrained Devices. Proceedings of the 2020 IEEE International Conference on Communications Workshops (ICC Workshops), Dublin, Ireland.
70. Jäger, S., Allhorn, A., and Bießmann, F. (2021). A Benchmark for Data Imputation Methods. Front. Big Data, 4.10.3389/fdata.2021.693674 ↗
71. A missing data imputation method for industrial soft sensor modeling10.1016/j.jprocont.2025.103485 ↗
72. RESI: A Region-Splitting Imputation method for different types of missing data10.1016/j.eswa.2020.114425 ↗
73. Adaptive optimization for prediction with missing data10.1007/s10994-025-06757-6 ↗
74. A method for filling missing values in multivariate sequence bidirectional recurrent neural networks based on feature correlations10.1016/j.jocs.2024.102472 ↗
75. Deep learning versus conventional methods for missing data imputation: A review and comparative study10.1016/j.eswa.2023.120201 ↗
76. Missing Data Imputation for Industrial Time Series with Adaptive Median Iteration Based on Generative Adversarial Networks10.1109/JSEN.2024.3457625 ↗
77. Missing Data Recovery Methods on Multivariate Time Series in IoT: A Comprehensive Survey10.1109/COMST.2025.3585962 ↗
78. Bejani, M., Mauri, M., and Mariani, S. (2025). Self-Attention-Based Deep Learning for Missing Sensor Data Imputation in Real-Time Probe Card Monitoring. Sensors, 25.10.3390/s25237194 ↗
79. Missing value imputation in multivariate time series with end-to-end generative adversarial networks10.1016/j.ins.2020.11.035 ↗
80. Zhang, X., Sun, X., Xia, L., Tao, S., and Xiang, S. (2024). A Matrix Completion Method for Imputing Missing Values of Process Data. Processes, 12.10.3390/pr12040659 ↗
81. Tensor-based statistical learning methods for diagnosing product quality defects in multistage manufacturing processes10.1080/24725854.2024.2385670 ↗
82. An Intelligent Approach to Data Quality Management AI-Powered Quality Monitoring in Analytics
83. Interactive Data Quality Dashboard: Integrating Real-Time Monitoring with Predictive Analytics for Proactive Data Management
84. Data Augmentation Techniques for Building Robust AI Models in Enterprise Applications
85. Data augmentation for numerical data from manufacturing processes: An overview of techniques and assessment of when which techniques work
86. Krishnamurthi, R., Kumar, A., Gopinathan, D., Nayyar, A., and Qureshi, B. (2020). An Overview of IoT Sensor Data Processing, Fusion, and Analysis Techniques. Sensors, 20.10.3390/s20216076 ↗
87. Edge Computing for Industry 5.0: Fundamental, Applications, and Research Challenges10.1109/JIOT.2024.3359297 ↗
88. Miller, R., Chan, S.H.M., Whelan, H., and Gregório, J. (2025). A Comparison of Data Quality Frameworks: A Review. Big Data Cogn. Comput., 9.10.3390/bdcc9040093 ↗
89. Miller, R., Whelan, H., Chrubasik, M., Whittaker, D., Duncan, P., and Gregório, J. (2024). A Framework for Current and New Data Quality Dimensions: An Overview. Data, 9.10.3390/data9120151 ↗
90. (2025, December 30). ISO 9001:2015. ISO. Available online: https://www.iso.org/standard/62085.html.
91. An Internet of Things platform for heterogeneous data integration: Methodology and application examples10.1016/j.jnca.2025.104197 ↗
92. Interoperability of heterogeneous Systems of Systems: From requirements to a reference architecture10.1007/s11227-023-05774-3 ↗
93. Adaptable Semantic Interoperability in Heterogeneous Smart Grids Using Large Language Models10.1016/j.egyr.2025.12.011 ↗
94. Deep Learning-Based Real-Time Data Quality Assessment and Anomaly Detection for Large-Scale Distributed Data Streams10.54660/IJMBHR.2025.6.1.01-11 ↗
95. Mastering Data Platform Design: Industry-Agnostic Patterns for Scale
96. Scalable AI: Leveraging Cloud and Edge Computing for Real-Time Analytics
97. Data Literacy Skills: Industry Perspectives and Professional Practice10.1353/pla.2025.a955946 ↗
98. Terras, M., Jones, V., Osborne, N., and Speed, C. (2024). Data-Driven Innovation in the Creative Industries, Routledge. [1st ed.].10.4324/9781003365891 ↗
99. Toward Cross-company Value Generation from Data: Investigating the Role of Data Sharing Communities
100. Gao, J., Lu, Y., Ashrafi, N., Domingo, I., Alaei, K., and Pishgar, M. (2024). Prediction of sepsis mortality in ICU patients using machine learning methods. BMC Med. Inf. Decis. Mak., 24.10.1186/s12911-024-02630-z ↗