journal article·2024-12-11Open access

A Method for Building a Mixed-Reality Digital Twin of a Roadheader Monitoring System

Xuedi Hao, Hanhui Lin, Han Jia, Yitong Cui, Shengjie Wang, Yingzong Gao, Ji Guang, Shirong Ge

Applied Sciences· Volume 14· Issue 24

Abstract

The working environment of the coal mine boom-type roadheader is harsh with large blind areas and numerous safety hazards for operators. Traditional on-site or remote control methods do not meet the requirements for intelligent tunneling. This paper proposes a digital twin monitoring system of an EBZ-type roadheader based on mixed reality (MR). First, the system integrates a five-dimensional digital twin model to establish the boom-type roadheader digital twin monitoring system. Second, the Unity3D software (v2020.3.25f1c1) and the MR Hololens (v22621.1133 produced by Microsoft) are used to build a digital twin human–machine interaction platform, achieving bidirectional mapping and driving of cutting operation data. Third, a twin data exchange program is designed by employing the Winform framework and the C/S communication architecture, making use of the socket communication protocol to transmit and store the cutting model data within the system. Finally, a physical prototype of the boom-type roadheader is built, and a validation experiment of the monitoring system’s digital twin is conducted. The experimental results show that the average transmission error of the cutting model data of the twin monitoring system is below 0.757%, and the execution accuracy error is below 3.7%. This system can achieve bidirectional real-time mapping and control between the twins, which provides a new monitoring method for actual underground roadheader operations. It effectively eliminates the operator’s blind areas and improves the intelligence level of roadheader monitoring. Beyond mining, this methodology can be extended to the monitoring and control of other mining equipment, predictive maintenance in manufacturing, and infrastructure management in smart cities.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Tunneling and Rock Mechanics · Advanced X-ray and CT Imaging · Digital Transformation in Industry

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Mechanical and Electrical Engineering, China University of Mining and Technology (Beijing), Beijing 100083, China

Key Laboratory of Intelligent Mining and Robotics, Ministry of Emergency Management, Beijing 100083, China

Funding

National Key Research and Development Program of China · Key Research and Development Program of Hebei Province

References (21)

Show source-provided references
1. Research Status and Prospects of Advanced Technology in Roadway Tunneling and Drilling
2. Analysis of Deep Mining in Coal Mines and Disaster Prevention in China
3. Performance Prediction of Roadheaders in Metallic Ore Excavation10.1016/j.tust.2013.09.009 ↗
4. Development of Position System of a Roadheader on a Base of Active IR-sensor10.1016/j.proeng.2015.01.412 ↗
5. Corke, P., Roberts, J., Cunningham, J., and Hainsworth, D. (2008). Mining Robotics. Springer Handbook of Robotics, Springer. [2nd ed.].10.1007/978-3-540-30301-5_50 ↗
6. Statistical Analysis on Coal Mine Accidents in China from 2013 to 2017 and Discussion on the Countermeasures
7. Prediction on the Energy Consumption and Coal Demand of China in 2025
8. Zhang, W., Zhai, G., Yue, Z., Pan, T., and Cheng, R. (2021). Research on Visual Positioning of a Roadheader and Construction of an Environment Map. Appl. Sci., 11.10.3390/app11114968 ↗
9. Wu, J., Yang, Y., Cheng, X., Zuo, H., and Cheng, Z. (2020, January 6–8). The Development of Digital Twin Technology Review. Proceedings of the 2020 Chinese Automation Congress (CAC 2020), Shanghai, China.10.1109/CAC51589.2020.9327756 ↗
10. Digital Twin: From Concept to Practice10.1061/(ASCE)ME.1943-5479.0001034 ↗
11. Application Prospects and Key Technologies of Digital Twin in Transmission and Transformation Equipment
12. Digital Twin Collaboration Technology Oriented to Human-Machine-Environment Integration10.3901/JME.2022.18.103 ↗
13. Tekinerdogan, B. (2023). On the Notion of Digital Twins: A Modeling Perspective. Systems, 11.10.3390/systems11010015 ↗
14. Research on Digital Twin Smart Mining Face Technology Architecture
15. Virtual Control Technology of Cantilever Roadheader Driven by Digital Twin
16. Remote Automatic Cutting Control Technology of Roadheader Driven by Digital Twin
17. Research and Application of Roadheader Remote Control Technology and Monitoring System
18. Real-time State Mapping of Roadheader Based on Digital Twin
19. Application and Future Development of Virtual Reality Technology in Media Industry
20. Mixed Reality Environment for Learning Sensing Technology Applications in Construction: A Usability Study10.1016/j.aei.2022.101637 ↗
21. Intelligent Optimal Control Considering Dynamic Posture Compensation for a Cantilever Roadheader10.1017/S0263574721000692 ↗