Development of a Remote Collaboration System for Interactive Communication with Building Information Model in Mixed Reality

Remote collaboration for construction site management is challenging. Building Information Modeling (BIM) provides the potential for remote collaboration based on its powerful data compatibility. Furthermore, the recently evolving Mixed Reality technology improves visual perception by superimposing 3D virtual BIM objects on real-world artifacts. This study proposes a remote collaboration system based on BIM in Mixed Reality. This system consists of three-unit systems: (1) Field Operator System (FOS), (2) Communication Server, and (3) Office Manager System (OMS). FOS was developed based on MR smart glasses for a field operator. The field operator can manipulate virtual BIM objects with finger-pointing cues and share the view with an office manager. FOS creates Mixed Reality Capture (MRC) video, the combined image of real-world images of existing artifacts in the construction site with virtual BIM elements superimposed on them, and sends it through the Communication Server to OMS. Thus, the office manager can see the field operator’s view through OMS based on a desktop or tablet PC. The office manager can give instructions to a field operator by voice through OMS. A user test was conducted to evaluate the applicability of the developed prototype system. As a result of the test, it was found that most of the testers had a positive evaluation of the developed system. This paper discusses the development of the BIM and MR-based remote collaboration and the test results.