Mapping Server Collaboration Architecture Design with OpenVSLAM for Mobile Devices
Source abstract
Abstract
SLAM technology, which is used for spatial recognition in autonomous driving and robotics, has recently emerged as an important technology to provide high-quality AR contents on mobile devices due to the spread of XR and metaverse technologies. In this paper, we designed, implemented, and verified the SLAM system that can be used on mobile devices. Mobile SLAM is composed of a stand-alone type that directly performs SLAM operation on a mobile device and a mapping server type that additionally configures a mapping server based on FastAPI to perform SLAM operation on the server and transmits data for map visualization to a mobile device. The mobile SLAM system proposed in this paper mixes the two types in order to make SLAM operation and map generation more efficient. The stand-alone type of SLAM system was configured as an Android app by porting the OpenVSLAM library to the Unity engine, and the map generation and performance were evaluated on desktop PCs and mobile devices. The mobile SLAM system in this paper is an open-source project, so it is expected to help develop AR contents based on SLAM in a mobile environment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotics and Automated Systems · Augmented Reality Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electronics Information System Engineering, Sangmyung University, 31 Sangmyungdae-gil, Dongnam-gu, Cheonan-si 31066, Chungcheongnam-do, Korea
Department of Information Security Engineering, Sangmyung University, 31 Sangmyungdae-gil, Dongnam-gu, Cheonan-si 31066, Chungcheongnam-do, Korea
Funding
Sangmyung University
References (34)
Show source-provided references
1. Esparza-Jiménez, J.O., Devy, M., and Gordillo, J.L. (2016). Visual EKF-SLAM from Heterogeneous Landmarks. Sensors, 16, Available online: http://lps3.www.ncbi.nlm.nih.gov.libproxy.smu.ac.kr/pubmed/27070602.10.3390/s16040489 ↗
2. Chul Roh, H., Hun Sung, C., and Jin Chung, M. (2013). Rapid SLAM using Simple Map Representation in Indoor Environment, IEEE.10.1109/FCV.2013.6485492 ↗
3. Jung, S., Choi, D., Song, S., and Myung, H. (2020). Bridge Inspection Using Unmanned Aerial Vehicle Based on HG-SLAM: Hierarchical Graph-based SLAM. Remote Sens., 12, Available online: http://lps3.doaj.org.libproxy.smu.ac.kr/article/b28d031fbd6a40e59e70f9563ae11c95.
4. CPL-SLAM: Efficient and Certifiably Correct Planar Graph-Based SLAM Using the Complex Number Representation
5. Simultaneous localization and mapping: Part I
6. Peddie, J. (2017). Types of Augmented Reality. Augmented Reality, Springer International Publishing.10.1007/978-3-319-54502-8 ↗
7. Piao, J.-C., and Kim, S.-D. (2017). Adaptive Monocular Visual–Inertial SLAM for Real-Time Augmented Reality Applications in Mobile Devices. Sensors, 17.10.3390/s17112567 ↗
8. (2022, February 03). Protobuf. Available online: https://developers.google.com/protocol-buffers.
9. Aslan, M.F., Durdu, A., Yusefi, A., Sabanci, K., and Sungur, C. (2021). A Tutorial: Mobile Robotics, SLAM, Bayesian Filter, Keyframe Bundle Adjustment and ROS Applications. Robot Operating System (ROS), Springer International Publishing.10.1007/978-3-030-75472-3_7 ↗
10. Visual and Visual-Inertial SLAM: State of the Art, Classification, and Experimental Benchmarking
11. ORB-SLAM: A Versatile and Accurate Monocular SLAM System
12. ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras
13. ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAM10.1109/TRO.2021.3075644 ↗
14. Sumikura, S., Shibuya, M., and Sakurada, K. (2019, January 15). OpenVSLAM, ACM. Proceedings of the 27th ACM International Conference on Multimedia, Nice, France.10.1145/3343031.3350539 ↗
15. El Filali, Y., and Krit, S. (2019). Augmented Reality Types and Popular Use Cases. Proceedings of the 1st International Conference of Computer Science and Renewable Energies—ICCSRE, IEEE Digital Library.10.5220/0009776301070110 ↗
16. (2022, February 03). Anonymous ARCore. Available online: https://developers.google.com/ar/develop.
17. (2022, February 03). Apple ARKit. Available online: https://developer.apple.com/documentation/arkit.
18. Rosinol, A., Abate, M., Chang, Y., and Carlone, L. (2020). Kimera: An Open-Source Library for Real-Time Metric-Semantic Localization and Mapping, IEEE.10.1109/ICRA40945.2020.9196885 ↗
19. Klein, G., and Murray, D. (2007). Parallel Tracking and Mapping for Small AR Workspaces, IEEE.10.1109/ISMAR.2007.4538852 ↗
20. Direct Sparse Odometry10.1109/TPAMI.2017.2658577 ↗
21. Engel, J., Schöps, T., and Cremers, D. (2014). LSD-SLAM: Large-Scale Direct Monocular SLAM. Computer Vision—ECCV 2014, Springer International Publishing.10.1007/978-3-319-10605-2_54 ↗
22. Forster, C., Pizzoli, M., and Scaramuzza, D. (2014). SVO: Fast Semi-Direct Monocular Visual Odometry, IEEE.10.1109/ICRA.2014.6906584 ↗
23. Schlegel, D., Colosi, M., and Grisetti, G. (2018). ProSLAM: Graph SLAM from a Programmer’s Perspective, IEEE.10.1109/ICRA.2018.8461180 ↗
24. Muñoz-Salinas, R., and Medina-Carnicer, R. (2020). UcoSLAM: Simultaneous localization and mapping by fusion of keypoints and squared planar markers. Pattern Recognit., 101, Available online: https://lps3.dx.doi.org.libproxy.smu.ac.kr/10.1016/j.patcog.2019.107193.10.1016/j.patcog.2019.107193 ↗
25. (2022, February 03). Anonymous Eigen. Available online: https://eigen.tuxfamily.org/index.php?title=Main_Page.
26. (2022, February 03). Rainer Kümmerle, g2o. Available online: https://github.com/RainerKuemmerle/g2o.
27. Muñoz-Salinas, R. (2022, February 03). Available online: https://github.com/OpenVSLAM-Community/FBoW.
28. (2022, February 03). FastAPI. Available online: https://fastapi.tiangolo.com/.
29. Hsu, M. (2021). LLVM Techniques, Tips, and Best Practices Clang and Middle-End Libraries, Packt Publishing, Limited.
30. (2022, February 03). Pangolin. Available online: https://github.com/uoip/pangolin.
31. The EuRoC micro aerial vehicle datasets10.1177/0278364915620033 ↗
32. (2022, February 03). Socket.IO. Available online: https://socket.io.
33. Horn, B.K.P. (1987). Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A Opt. Image Sci. Vis., 4.10.1364/JOSAA.4.000629 ↗
34. Aslan, M.F., Durdu, A., Sabanci, K., Ropelewska, E., and Gültekin, S.S. (2022). A Comprehensive Survey of the Recent Studies with UAV for Precision Agriculture in Open Fields and Greenhouses. Appl. Sci., 12.10.3390/app12031047 ↗