journal article·2023-12-07Open access

FiMa-Reader: A Cost-Effective Fiducial Marker Reader System for Autonomous Mobile Robot Docking in Manufacturing Environments

Xu Bian, Wenzhao Chen, Donglai Ran, Zhimou Liang, Xuesong Mei

Applied Sciences· Volume 13· Issue 24

Abstract

Accurately docking mobile robots to various workstations on the factory floor is a common and essential task. The existing docking methods face three major challenges: intricate deployment procedures, susceptibility to ambient lighting, and incapacity to recognize product information during the docking process. This paper devises a novel approach that combines the features of ArUco and Data Matrix to form a composite marker termed “DataMatrix-ArUco-Hybrid” (DAH). The DAH pattern serves as a fiducial marker capable of concurrently providing both target pose information and product information. Detection of the DAH pattern is conducted by a cost-effective fiducial marker reader system, called “FiMa-Reader”, which comprises an embedded processing unit and an infrared camera equipped with a 940 nm fill-light to overcome lighting issues. The FiMa-Reader system effectively detects the DAH pattern under both well-lit and dimly lit conditions. Additionally, the implementation of the FiMa-Reader system leads to significant improvements in positioning accuracy, including an 86.42% improvement on the x-axis, a 44.7% improvement on the y-axis, and an 84.21% improvement in angular orientation when compared to traditional navigation methods. The utilization of FiMa-Reader presents an economically viable system capable of guiding mobile robots’ positioning with high precision in various indoor lighting conditions.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Sensor-Based Localization · Indoor and Outdoor Localization Technologies · Augmented Reality Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical Engineering, Xi’an Jiaotong University, Xi’an 710049, China

Research and Development Department, Shenzhen Youibot Robotics Co., Ltd., Shenzhen 518100, China

Funding

Key Research and Development Program of Shaanxi · National Key Research and Development Plan

References (34)

Show source-provided references
1. Production and maintenance in industries: Impact of industry 4.0
2. Automation technology as a key component of the Industry 4.0 production development path10.1007/s00170-021-07246-5 ↗
3. Increasing flexibility and productivity in Industry 4.0 production networks with autonomous mobile robots and smart intralogistics10.1007/s10479-020-03526-7 ↗
4. Autonomous mobile robots for recycling metal shaving at CNC factories10.1007/s00170-023-11284-6 ↗
5. Improving navigation stack of a ros-enabled industrial autonomous mobile robot (amr) to be incorporated in a large-scale automotive production10.1007/s00170-022-08883-0 ↗
6. Robots in industry: The past, present, and future of a growing collaboration with humans10.1109/MIE.2020.3008136 ↗
7. Modelless guidance for the docking of autonomous vehicles10.1109/TRO.2007.900634 ↗
8. Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age10.1109/TRO.2016.2624754 ↗
9. Bostelman, R., Bostelman, R., and Hong, T. (2016). Review of Research for Docking Automatic Guided Vehicles and Mobile Robots, US Department of Commerce—National Institute of Standards and Technology.10.6028/NIST.IR.8140 ↗
10. Vukolov, A., Kourousias, G., and Pugliese, R. (2022, January 8–10). Flexible vision-based auto-docking control system for unmanned ground vehicles equipped with differential chassis. Proceedings of the International Conference on Robotics in Alpe-Adria Danube Region, Klagenfurt am Wörthersee, Austria.10.1007/978-3-031-04870-8_47 ↗
11. Autonomous target docking of nonholonomic mobile robots using relative pose measurements10.1109/TIE.2020.3001805 ↗
12. Bolanakis, G., Nanos, K., and Papadopoulos, E. (2021, January 12–16). A QR Code-based High-Precision Docking System for Mobile Robots Exhibiting Submillimeter Accuracy. Proceedings of the 2021 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Delft, The Netherlands.10.1109/AIM46487.2021.9517507 ↗
13. Tsiogas, E., Kleitsiotis, I., Kostavelis, I., Kargakos, A., Giakoumis, D., Bosch-Jorge, M., Ros, R.J., Tarazón, R.L., Likothanassis, S., and Tzovaras, D. (October, January 27). Pallet detection and docking strategy for autonomous pallet truck agv operation. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9636270 ↗
14. A laser intensity based autonomous docking approach for mobile robot recharging in unstructured environments10.1109/ACCESS.2022.3188099 ↗
15. Hercik, R., Byrtus, R., Jaros, R., and Koziorek, J. (2022). Implementation of autonomous mobile robot in smartfactory. Appl. Sci., 12.10.3390/app12178912 ↗
16. A precise scan matching based localization method for an autonomously guided vehicle in smart factories10.1016/j.rcim.2021.102302 ↗
17. Precise transhippment control of an automated magnetic-guided vehicle using optics positioning
18. Positioning accuracy improvement of automated guided vehicles based on a novel magnetic tracking approach10.1109/MITS.2018.2880269 ↗
19. Falkowski, P., Smater, M., Koper, J., Myśliwiec, A., and Mackiewicz, T. (August, January 31). An Approach towards high-precision docking of the mobile robots for industrial purposes. Proceedings of the Conference on Automation, Paris, France.
20. Pose alignment of aircraft structures with distance sensors and CCD cameras10.1016/j.rcim.2017.02.003 ↗
21. High-accuracy vehicle localization for autonomous warehousing10.1016/j.rcim.2016.05.001 ↗
22. Speeded up detection of squared fiducial markers10.1016/j.imavis.2018.05.004 ↗
23. Wang, J., and Olson, E. (2016, January 9–14). AprilTag 2: Efficient and robust fiducial detection. Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Republic of Korea.10.1109/IROS.2016.7759617 ↗
24. Zhang, H., Zhang, C., Yang, W., and Chen, C.Y. (2015, January 6–9). Localization and navigation using QR code for mobile robot in indoor environment. Proceedings of the 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), Zhuhai, China.10.1109/ROBIO.2015.7419715 ↗
25. Tian, W., Chen, D., Yang, Z., and Yin, H. (January, January 24). The application of navigation technology for the medical assistive devices based on Aruco recognition technology. Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9341231 ↗
26. An intelligent robot for indoor substation inspection10.1108/IR-09-2019-0193 ↗
27. Implementation of autonomous docking and charging for a supporting robotic fish10.1109/TIE.2022.3201329 ↗
28. Xu, Z., Haroutunian, M., Murphy, A.J., Neasham, J., and Norman, R. (2021). An underwater visual navigation method based on multiple ArUco markers. J. Mar. Sci. Eng., 9.10.3390/jmse9121432 ↗
29. Jin, S., Zhang, J., Shen, L., and Li, T. (2016, January 27–29). On-board vision autonomous landing techniques for quadrotor: A survey. Proceedings of the 2016 35th Chinese Control Conference (CCC), Chengdu, China.10.1109/ChiCC.2016.7554984 ↗
30. Magdalena Nowara, E., Marks, T.K., Mansour, H., and Veeraraghavan, A. (2018, January 18–22). SparsePPG: Towards driver monitoring using camera-based vital signs estimation in near-infrared. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00174 ↗
31. On the design and development of attitude stabilization, vision-based navigation, and aerial gripping for a low-cost quadrotor10.1007/s10514-012-9286-z ↗
32. Hijikata, S., Terabayashi, K., and Umeda, K. (2009, January 17–19). A simple indoor self-localization system using infrared LEDs. Proceedings of the 2009 Sixth International Conference on Networked Sensing Systems (INSS), Pittsburgh, PA, USA.10.1109/INSS.2009.5409955 ↗
33. Fiducial Markers for Pose Estimation10.1007/s10846-020-01307-9 ↗
34. Infinitesimal plane-based pose estimation10.1007/s11263-014-0725-5 ↗