journal article·2025-11-29Open access

Natural Language Processing in Generating Industrial Documentation Within Industry 4.0/5.0

Izabela Rojek, Olga Małolepsza, Mirosław Kozielski, Dariusz Mikołajewski

Applied Sciences· Volume 15· Issue 23

Abstract

Deep learning (DL) methods have revolutionized natural language processing (NLP), enabling industrial documentation systems to process and generate text with high accuracy and fluency. Modern deep learning models, such as transformers and recurrent neural networks (RNNs), learn contextual relationships in text, making them ideal for analyzing and creating complex industrial documentation. Transformer-based architectures, such as BERT (Bidirectional Encoder Representations from Transformers) and GPT (Generative Pre-trained Transformer), are ideally suited for tasks such as text summarization, content generation, and question answering, which are crucial for documentation systems. Pre-trained language models, tuned to specific industrial datasets, support domain-specific vocabulary, ensuring the generated documentation complies with industry standards. Deep learning-based systems can use sequential models, such as those used in machine translation, to generate documentation in multiple languages, promoting accessibility, and global collaboration. Using attention mechanisms, these models identify and highlight critical sections of input data, resulting in the generation of accurate and concise documentation. Integration with optical character recognition (OCR) tools enables DL-based NLP systems to digitize and interpret legacy documents, streamlining the transition to automated workflows. Reinforcement learning and human feedback loops can enhance a system’s ability to generate consistent and contextually relevant text over time. These approaches are particularly effective in creating dynamic documentation that is automatically updated based on data from sensors, registers, or other sources in real time. The scalability of DL techniques enables industrial organizations to efficiently produce massive amounts of documentation, reducing manual effort and improving overall efficiency. NLP has become a fundamental technology for automating the generation, maintenance, and personalization of industrial documentation within the Industry 4.0, 5.0, and emerging Industry 6.0 paradigms. Recent advances in large language models, search-assisted generation, and multimodal architectures have significantly improved the accuracy and contextualization of technical manuals, maintenance reports, and compliance documents. However, persistent challenges such as domain-specific terminology, data scarcity, and the risk of hallucinations highlight the limitations of current approaches in safety-critical manufacturing environments. This review synthesizes state-of-the-art methods, comparing rule-based, neural, and hybrid systems while assessing their effectiveness in addressing industrial requirements for reliability, traceability, and real-time adaptation. Human–AI collaboration and the integration of knowledge graphs are transforming documentation workflows as factories evolve toward cognitive and autonomous systems. The review included 32 articles published between 2018 and 2025. The implications of these bibliometric findings suggest that a high percentage of conference papers (69.6%) may indicate a field still in its conceptual phase, which contextualizes the article’s emphasis on proposed architecture rather than their industrial validation. Most research was conducted in computer science, suggesting early stages of technological maturity. The leading countries were China and India, but these countries did not have large publication counts, nor were leading researchers or affiliations observed, suggesting significant research dispersion. However, the most frequently observed SDGs indicate a clear health context, focusing on “industry innovation and infrastructure” and “good health and well-being”.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Handwritten Text Recognition Techniques · Artificial Intelligence Applications · Multimodal Machine Learning Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Computer Science, Kazimierz Wielki University, 30 Chodkiewicza St., 85-064 Bydgoszcz, Poland

Funding

Kazimierz Wielki University

References (85)

Show source-provided references
1. Modern approach to sustainable production in the context of Industry 4.0
2. Petro NLP: Resources for natural language processing and information extraction for the oil and gas industry10.1016/j.cageo.2024.105714 ↗
3. He, S., and Lu, Y. (2019). A Modularized Architecture of Multi-Branch Convolutional Neural Network for Image Captioning. Electronics, 8.10.3390/electronics8121417 ↗
4. Kim, H.-S., Kang, J.-W., and Choi, S.-Y. (2025). ChatGPT vs. Human Journalists: Analyzing News Summaries Through BERT Score and Moderation Standards. Electronics, 14.10.3390/electronics14112115 ↗
5. Mikołajewska, E., and Masiak, J. (2025). Deep Learning Approaches to Natural Language Processing for Digital Twins of Patients in Psychiatry and Neurological Rehabilitation. Electronics, 14.10.3390/electronics14102024 ↗
6. Kayabas, A., Topcu, A.E., Alzoubi, Y.I., and Yıldız, M. (2025). A Deep Learning Approach to Classify AI-Generated and Human-Written Texts. Appl. Sci., 15.10.3390/app15105541 ↗
7. Pan, K., Zhang, X., and Chen, L. (2024). Research on the Training and Application Methods of a Lightweight Agricultural Domain-Specific Large Language Model Supporting Mandarin Chinese and Uyghur. Appl. Sci., 14.10.3390/app14135764 ↗
8. Orji, E.Z., Haydar, A., Erşan, İ., and Mwambe, O.O. (2023). Advancing OCR Accuracy in Image-to-LaTeX Conversion—A Critical and Creative Exploration. Appl. Sci., 13.10.3390/app132212503 ↗
9. Feichter, C., and Schlippe, T. (2024). Investigating Models for the Transcription of Mathematical Formulas in Images. Appl. Sci., 14.10.3390/app14031140 ↗
10. Lamaakal, I., Maleh, Y., El Makkaoui, K., Ouahbi, I., Pławiak, P., Alfarraj, O., Almousa, M., and Abd El-Latif, A.A. (2025). Tiny Language Models for Automation and Control: Overview, Potential Applications, and Future Research Directions. Sensors, 25.10.3390/s25051318 ↗
11. Al-Safi, H., Ibrahim, H., and Steenson, P. (2025). Vega: LLM-Driven Intelligent Chatbot Platform for Internet of Things Control and Development. Sensors, 25.10.20944/preprints202505.0380.v1 ↗
12. Javed, S., Usman, M., Sandin, F., Liwicki, M., and Mokayed, H. (2023). Deep Ontology Alignment Using a Natural Language Processing Approach for Automatic M2M Translation in IIoT. Sensors, 23.10.20944/preprints202309.1413.v1 ↗
13. Wang, J., Tang, Y., He, S., Zhao, C., Sharma, P.K., Alfarraj, O., and Tolba, A. (2020). Log Event2vec: Log Event-to-Vector Based Anomaly Detection for Large-Scale Logs in Internet of Things. Sensors, 20.10.3390/s20092451 ↗
14. Rutkowski, L., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., and Zurada, J.M. (2010). Hybrid Neural Networks as Prediction Models. Artificial Intelligence and Soft Computing, Lecture Notes in Artificial Intelligence, Springer.10.1007/978-3-642-13208-7 ↗
15. Models for Better Environmental Intelligent Management within Water Supply Systems10.1007/s11269-014-0654-7 ↗
16. Vaiyapuri, T., Jagannathan, S.K., Ahmed, M.A., Ramya, K.C., Joshi, G.P., Lee, S., and Lee, G. (2023). Sustainable Artificial Intelligence-Based Twitter Sentiment Analysison COVID-19 Pandemic. Sustainability, 15.10.3390/su15086404 ↗
17. Cortés-Caicedo, B., Grisales-Noreña, L.F., Montoya, O.D., Rodriguez-Cabal, M.A., and Rosero, J.A. (2022). Energy Management System for the Optimal Operation of PV Generators in Distribution Systems Using the Antlion Optimizer: A Colombian Urban and Rural Case Study. Sustainability, 14.10.3390/su142316083 ↗
18. Jamii, J., Trabelsi, M., Mansouri, M., Mimouni, M.F., and Shatanawi, W. (2022). Non-Linear Programming-Based Energy Management for a Wind Farm Coupled with Pumped Hydro Storage System. Sustainability, 14.10.3390/su141811287 ↗
19. Choi, S.-W., Lee, E.-B., and Kim, J.-H. (2021). The Engineering Machine-Learning Automation Platform (EMAP): A Big-Data-Driven AI Tool for Contractors’ Sustainable Management Solutions for Plant Projects. Sustainability, 13.10.3390/su131810384 ↗
20. Alqahtani, E., Janbi, N., Sharaf, S., and Mehmood, R. (2022). Smart Homes and Families to Enable Sustainable Societies: A Data-Driven Approach for Multi-Perspective Parameter Discovery Using BERT Modelling. Sustainability, 14.10.20944/preprints202208.0233.v1 ↗
21. Ali, S., and Shirazi, F. (2022). A Transformer-Based Machine Learning Approach for Sustainable E-Waste Management: A Comparative Policy Analysis between the Swiss and Canadian Systems. Sustainability, 14.10.3390/su142013220 ↗
22. Nam, S., Yoon, S., Raghavan, N., and Park, H. (2021). Identifying Service Opportunities Based on Outcome-Driven Innovation Framework and Deep Learning: A Case Study of Hotel Service. Sustainability, 13.10.3390/su13010391 ↗
23. Predictive compensation of thermal deformations of ball screws in cnc machines using neural networks
24. Rojek, I., Mikołajewski, D., Kotlarz, P., Tyburek, K., Kopowski, J., and Dostatni, E. (2021). Traditional Artificial Neural Networks Versus Deep Learning in Optimization of Material Aspects of 3D Printing. Materials, 14.10.3390/ma14247625 ↗
25. Bäckstrand, E., Djupedal, R., Öberg, L.M., and de Oliveira Neto, F.G. (2024, January 20). Unveiling Disparities: NLP Analysis of Software Industry and Vocational Education Gaps. Proceedings of the Third ACM/IEEE International Workshop on NL-Based Software Engineering, Lisbon, Portugal.10.1145/3643787.3648029 ↗
26. Lindh-Knuutila, T., Loftsson, H., Doval, P.A., Andersson, S., Barkarson, B., Cerezo-Costas, H., Guðnason, J., Gylfason, J., Hemminki, J., and Kaalep, H.J. (2023, January 22–24). Microservices at Your Service: Bridging the Gap between NLP Research and Industry. Proceedings of the 24th Nordic Conference on Computational Linguistics (NoDaLiDa), Tórshavn, Faroe Islands.
27. RojasGonzález, T., Rocha, M.A., Baltazar, R., Casillas, M.A., and del Valle, J. (2022, January 20–22). Voice Control System Through NLP (Natural Language Processing) as an Interactive Model for Scalable ERP Platforms in Industry 4.0. Proceedings of the Agents and Multi-Agent Systems: Technologies and Applications 2022: Proceedings of 16th KES International Conference, KES-AMSTA, Rhodes, Greece.10.1007/978-981-19-3359-2_18 ↗
28. Benchmark Data NLP.jl: Synthetic Data Generation for NLP Benchmarking10.21105/joss.07844 ↗
29. Predicting learning performance using NLP: An exploratory study using two semantic textual similarity methods10.1007/s10115-024-02293-2 ↗
30. NLP in SMEs for industry 4.0: Opportunities and challenges10.1016/j.procs.2024.06.186 ↗
31. ESG-KIBERT: A new paradigm in ESG evaluation using NLP and industry-specific customization10.1016/j.dss.2025.114440 ↗
32. Czeczot, G., Rojek, I., Mikołajewski, D., and Sangho, B. (2023). AI in IIoT Management of Cybersecurity for Industry 4.0 and Industry 5.0 Purposes. Electronics, 12.10.3390/electronics12183800 ↗
33. Rojek, I., Mroziński, A., Kotlarz, P., Macko, M., and Mikołajewski, D. (2023). AI-Based Computational Model in Sustainable Transformation of Energy Markets. Energies, 16.10.3390/en16248059 ↗
34. Alrashidi, B., Jamal, A., and Alkhathlan, A. (2023). Abusive Content Detection in Arabic Tweets Using Multi-Task Learning and Transformer-Based Models. Appl. Sci., 13.10.3390/app13105825 ↗
35. Al Duhayyim, M., Alazwari, S., Mengash, H.A., Marzouk, R., Alzahrani, J.S., Mahgoub, H., Althukair, F., and Salama, A.S. (2022). Metaheuristics Optimization with Deep Learning Enabled Automated Image Captioning System. Appl. Sci., 12.10.3390/app12157724 ↗
36. Kumar, G., Basri, S., Imam, A.A., Khowaja, S.A., Capretz, L.F., and Balogun, A.O. (2021). Data Harmonization for Heterogeneous Datasets: A Systematic Literature Review. Appl. Sci., 11.10.3390/app11178275 ↗
37. Software architectures for big data: A systematic literature review10.1186/s41044-020-00045-1 ↗
38. Overview of Big Data and Its Issues
39. Challenges and recommended technologies for the industrial internet of things: A comprehensive review10.1016/j.measurement.2019.107198 ↗
40. Use of Big Data Tools and Industrial Internet of Things: An Overview
41. Ralph, B., and Stockinger, M. (2020, January 21–25). Digitalization and digital transformation in metal forming: Key technologies, challenges and current developments of industry 4.0 applications. Proceedings of the XXXIX, Colloquium on Metal Forming, Leoben, Austria.
42. Cohort Harmonization and Integrative Analysis from a Biomedical Engineering Perspective10.1109/RBME.2018.2855055 ↗
43. A Survey on the Internet of Things (IoT) Forensics: Challenges, Approaches, and Open Issues10.1109/COMST.2019.2962586 ↗
44. A Review on the Research Growth of Industry 4.0: IIoT Business Architectures Benchmarking10.4018/IJBAN.2020010105 ↗
45. Khan, M., Wu, X., Xu, X., and Dou, W. (2017, January 21–25). Big data challenges and opportunities in the hype of Industry 4.0. Proceedings of the 2017 IEEE International Conference on Communications (ICC), Paris, France.10.1109/ICC.2017.7996801 ↗
46. Data science applications for predictive maintenance and materials science in context to Industry 4.010.1016/j.matpr.2021.01.357 ↗
47. Jagtap, S., Bader, F., Garcia-Garcia, G., Trollman, H., Fadiji, T., and Salonitis, K. (2020). Food Logistics 4.0: Opportunities and Challenges. Logistics, 5.10.3390/logistics5010002 ↗
48. IoT in Supply Chain Management: Opportunities and Challenges for Businesses in Early Industry 4.0 Context
49. A Framework for Extended Reality System Development in Manufacturing10.1109/ACCESS.2021.3056752 ↗
50. A review of affective computing: From unimodal analysis to multimodal fusion10.1016/j.inffus.2017.02.003 ↗
51. Multimodal big data affective analytics: A comprehensive survey using text, audio, visual and physiological signals10.1016/j.jnca.2019.102447 ↗
52. Big data analytics: Challenges and applications for text, audio, video, and social media data
53. A Deep Learning Framework for Automatic Detection of Hate Speech Embeddedin Arabic Tweets10.1007/s13369-021-05383-3 ↗
54. Pontikis, I., Koutivas, S., and Stafylas, D. (2022, January 29–30). Greek Patent Classification Using Deep Learning. Proceedings of the Novel & Intelligent Digital Systems: The 2nd International Conference on Novel and Intelligent Digital Systems-NiDS, Athens, Greece.10.1007/978-3-031-17601-2_36 ↗
55. Intelligent compilation of patent summaries using machine learning and natural language processing techniques10.1016/j.aei.2019.101027 ↗
56. Construction of design requirements knowledge base from unstructured design guidelines using natural language processing10.1016/j.compind.2024.104100 ↗
57. Rahman, M.M., and Finin, T. (2017, January 5–8). Deep Understanding of a Document’s Structure. Proceedings of the Fourth IEEE/ACM International Conference on Big Data Computing, Applications And Technologies, Austin, TX, USA.10.1145/3148055.3148080 ↗
58. Efficient and Privacy-Preserving Authentication Protocol for Heterogeneous Systems in IIoT10.1109/JIOT.2020.2999510 ↗
59. The Challenges of Integrating Industry 4.0 in Cyber Security—A Perspective
60. Multistage implementation framework for smart supply chain management under industry 4.010.1016/j.techfore.2020.120354 ↗
61. Deep learning and embeddings - based approaches for key phrase extraction: A literature review10.1007/s10115-024-02164-w ↗
62. (2017). Standard Data Element Types with Associated Classification Scheme—Part 1: Definitions—Principles and Methods (Standard No. IEC 61360-1:2017). Available online: https://webstore.iec.ch/en/publication/28560.
63. (2004). Industrial Automation Systems and Integration—Industrial Manufacturing Management Data Part 1: General Overview (Standard No. ISO 15531-1:2004). Available online: https://www.iso.org/standard/28144.html.
64. Natural language processing for smart construction: Current status and future directions10.1016/j.autcon.2021.104059 ↗
65. Learning of indiscriminate distributions of document embeddings for domain adaptation10.3233/IDA-184131 ↗
66. Mohammadi, H., Giachanou, A., and Bagheri, A. (2024). A Transparent Pipeline for Identifying Sexism in Social Media: Combining Explainability with Model Prediction. Appl. Sci., 14.10.3390/app14198620 ↗
67. Pérez-Landa, G.I., Loyola-González, O., and Medina-Pérez, M.A. (2021). An Explainable Artificial Intelligence Model for Detecting Xenophobic Tweets. Appl. Sci., 11.10.3390/app112210801 ↗
68. (2025, October 28). Directive (EU) 2022/2555 of the European Parliament and of the Council of 14 December 2022 on Measures for a High Common Level of Cybersecurity Across the Union, Amending Regulation (EU) No 910/2014 and Directive (EU) 2018/1972, and Repealing Directive (EU) 2016/1148 (NIS 2 Directive). Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:32022L2555.
69. (2018). Information Technology—Service Management Part 1: Service Management System Requirements (Standard No. ISO/IEC 20000-1:2018). Available online: https://www.iso.org/standard/70636.html.
70. Natural language processing-based approach for automatically coding ship sensor data10.1016/j.ijnaoe.2023.100581 ↗
71. Empirical evaluation of deep learning models for sentiment analysis
72. Li, Z., Zhang, Q., Wang, Y., and Wang, S. (2020). Social Media Rumor Refuter Feature Analysis and Crowd Identification Basedon XGBoost and NLP. Appl. Sci., 10.10.3390/app10144711 ↗
73. Wu, H., Zhong, B., Medjdoub, B., Xing, X., and Jiao, L. (2020). An Ontological Metro Accident Case Retrieval Using CBR and NLP. Appl. Sci., 10.10.3390/app10155298 ↗
74. Mishra, R.K., Raj, H., Urolagin, S., Jothi, J.A.A., and Nawaz, N. (2022). Cluster-Based Knowledge Graph and Entity-Relation Representation on Tourism Economical Sentiments. Appl. Sci., 12.10.3390/app12168105 ↗
75. Gulnerman, A.G. (2025). Do Spatial Trajectories of Social Media Users Implythe Credibility of the Users’ Tweets During Earthquake Crisis Management?. Appl. Sci., 15.10.3390/app15126897 ↗
76. Liu, K., Wang, P., and Liu, J. (2025). Evaluation of Cultural Ecosystem Services in the Urban Parks of Macau from a Cultural Heritage Perspective. Appl. Sci., 15.10.3390/app15073946 ↗
77. Zhou, J., and Zhang, H. (2025). Transforming Education in the AI Era: A Technology–Organization–Environment Framework Inquiryin to Public Discourse. Appl. Sci., 15.10.3390/app15073886 ↗
78. Ptaszynski, M., Dybala, P., and Rzepka, R. (2024). Application of Artificial Intelligence Methods in Processing of Emotions, Decisions, and Opinions. Appl. Sci., 14.10.3390/app14135912 ↗
79. Peykani, P., Ramezanlou, F., Tanasescu, C., and Ghanidel, S. (2025). Large Language Models: A Structured Taxonomy and Review of Challenges, Limitations, Solutions, and Future Directions. Appl. Sci., 15.10.3390/app15148103 ↗
80. Benavides-Astudillo, E., Fuertes, W., Sanchez-Gordon, S., Nuñez-Agurto, D., and Rodríguez-Galán, G. (2023). A Phishing-Attack-Detection Model Using Natural Language Processing and Deep Learning. Appl. Sci., 13.10.3390/app13095275 ↗
81. Wani, M.A., El Affendi, M., and Shakil, K.A. (2024). AI-Generated Spam Review Detection Framework with Deep Learning Algorithms and Natural Language Processing. Computers, 13.10.3390/computers13100264 ↗
82. Eleftheriadis, P., Perikos, I., and Hatzilygeroudis, I. (2023). Evaluating Deep Learning Techniques for Natural Language Inference. Appl. Sci., 13.10.3390/app13042577 ↗
83. Ricketts, J., Barry, D., Guo, W., and Pelham, J. (2023). A Scoping Literature Review of Natural Language Processing Application to Safety Occurrence Reports. Safety, 9.10.3390/safety9020022 ↗
84. Park, H.A., Jeon, I., Shin, S.-H., Seo, S.Y., Lee, J.J., Kim, C., and Park, J.O. (2024). Natural Language Processing-Based Deep Learning to Predict the Loss of Consciousness Event Using Emergency Department Text Records. Appl. Sci., 14.10.3390/app142311399 ↗
85. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews10.1136/bmj.n71 ↗