Enhancement of Robot Position Control for Dual-User Operation of Remote Robot System with Force Feedback
Source abstract
Abstract
We focus on dual-user operation, where two users control a single remote robot equipped with a force sensor using haptic interface devices. We employ a cooperative work in which the two users control the remote robot to collaborate with remote robot systems with force feedback to carry an object. By measuring the force acting upon the object, we aim to better understand the underlying mechanisms by which the user with lower network latency can help the other user, as observed in our previous work. We notice that with increasing network delays, the force exerted on the object tends to intensify, indicating that it becomes more challenging for users to operate the remote robot effectively as network delays increase. We also measure the force applied to the object by changing the network delays between the remote robot and the two users to clarify why the user with the lower network delay can assist the other user. We find that when the total network delay is the same, the average force magnitude and the average maximum force magnitude remain nearly identical. This is because, despite the challenges faced by the user with the larger network delay, the user with the smaller delay can operate the remote robot more easily and assist the other user. In order to reduce the force acting upon the object, we propose an enhancement method for the robot position control, which determines the position of the remote robot arm while accounting for network delay, and investigate the effects by experiment. Experimental results demonstrate that our proposed method is effective and can reduce the applied force. This is because the proposed method adjusts the ratio between the user with the lower delay and the user with the higher delay. The user with the lower delay can operate the remote robot more easily and respond to it more quickly. Our findings and proposed method can be useful in improving work accuracy and operability when designing a remote robot system with force feedback for applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Teleoperation and Haptic Systems · Robotics and Automated Systems · Robot Manipulation and Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Economics and Information, Gifu Shotoku Gakuen University, Gifu 500-8288, Japan
Faculty of Business Administration, Aichi Sangyo University, Okazaki 444-0005, Japan
Funding
JSPS KAKENHI
References (29)
Show source-provided references
1. Real world haptics: Its principle and future prospects
2. Haptic-guided teleoperation of a 7-DoF collaborative robot arm with an identical twin master10.1109/TOH.2020.2971485 ↗
3. Comparison of three feedback modalities for haptics sensation in remote machine manipulation10.1109/LRA.2021.3070301 ↗
4. Development of an intuitive interface with haptic enhancement for robot-assisted endovascular intervention10.1109/TOH.2023.3346479 ↗
5. Huang, P., and Ishibashi, Y. (2021). QoS control in remote robot operation with force feedback. Robotics Software Design and Engineering, IntechOpen.10.5772/intechopen.97011 ↗
6. Seminara, L., Gastaldo, P., Watt, S., Valyear, K., Zuher, F., and Mastrogiovanni, F. (2019). Active Haptic Perception in Robots: A Review. Front. Neurorobotics, 13.10.3389/fnbot.2019.00053 ↗
7. Rakhmatulin, V., Cabrera, M., Hagos, F., Sautenkov, O., Tirado, J., and Uzhinsky, I. (2021, January 17). Tsetserukou, CoboGuider: Haptic Potential Fields for Safe Human-Robot Interaction. Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics (SMC), Melbourne, Australia.10.1109/SMC52423.2021.9658716 ↗
8. Ueda, Y., Miyahara, S., Tokushi, K., and Sato, T. (2023). Impact of a pneumatic surgical robot with haptic feedback function on surgical manipulation. Sci. Rep., 13.10.1038/s41598-023-49876-7 ↗
9. Force feedback haptic interface for bilateral teleoperation of robot manipulation10.1007/s00542-022-05382-w ↗
10. Bergholz, M., Ferle, M., and Weber, B. (2023). The benefits of haptic feedback in robot assisted surgery and their moderators: A meta-analysis. Sci. Rep., 13.10.1038/s41598-023-46641-8 ↗
11. Huang, P., and Ishibashi, Y. (2022). Cooperation among humans and robots in remote robot systems with force feedback. Human-Robot Interaction—Perspectives and Applications, IntechOpen.10.5772/intechopen.106951 ↗
12. Masaki, R., Kobayashi, M., and Motoi, N. (2022). Remote-controlled method with force and visual assists based on time to collision for mobile robot. Appl. Sci., 12.10.3390/app12083727 ↗
13. Robot-assisted teleoperation ultrasound system based on fusion of augmented reality and predictive force10.1109/TIE.2022.3201322 ↗
14. Sensorless based haptic feedback integration in robot-assisted pedicle screw insertion for lumbar spine surgery: A preliminary cadaveric study10.1016/j.csbj.2024.05.022 ↗
15. Lukin, A., Demidova, G., Rassolkin, A., Vaimann, T., and Roozbahani, H. (2020, January 27–30). Force-based feedback for haptic device of mobile assembly robot. Proceedings of the 27th International Workshop on Electric Drives, Moscow, Russia.10.1109/IWED48848.2020.9069581 ↗
16. Alfaro, D., Puente, S., and Ubieta, I. (2023). Trajectory generation using dual-robot haptic interface for reinforcement learning from demonstration. Lecture Notes in Networks and Systems, Springer.
17. ITU-T Rec (2024, August 01). I. 350 General Aspects of Quality of Service and Network Performance in Digital Networks. Available online: https://www.itu.int/rec/T-REC-I.350-199303-I.
18. ITU-T Rec (2024, August 01). G. 100/P. 10 Amendment 1, New Appendix I: Definition of Quality of Experience (QoE). Available online: https://www.itu.int/rec/T-REC-P.10-200701-S!Amd1.
19. A bilateral control system to synchronize with haptic and visual sense for teleoperation over network
20. Force and position coordination for delayed bilateral teleoperation of a manipulator robot10.1007/s40435-023-01298-z ↗
21. Hagiwara, T., Ganesh, G., Sugimoto, M., Inami, M., and Kitazaki, M. (2020). Individuals prioritize the reach straightness and hand jerk of a shared avatar over their own. iScience, 23.10.1016/j.isci.2020.101732 ↗
22. Effects of collaborative training using virtual co-embodiment on motor skill learning10.1109/TVCG.2023.3247112 ↗
23. Ye, R., Jasmin, S., and Ishibashi, Y. (2023, January 17–19). One user operation versus two users operation in cooperative remote robot systems. Proceedings of the IEEE International Conference on Consumer Electronics, Taiwan.10.1109/ICCE-Taiwan58799.2023.10226750 ↗
24. (2024, August 01). Available online: https://www.3dsystems.com/haptics-devices/touch.
25. Enhancement of Stabilization Control in Remote Robot System with Force Feedback
26. Miyoshi, T., Terashima, K., and Buss, M. (2006, January 4–6). A design method of wave filter for stabilizing non-passive operating system. Proceedings of the 2006 IEEE Conference on Computer Aided Control System Design, 2006 IEEE International Conference on Control Applications, 2006 IEEE International Symposium on Intelligent Control, Munich, Germany.10.1109/CACSD-CCA-ISIC.2006.4776833 ↗
27. Miyoshi, T., Imamura, T., and Terashima, K. (2015, January 9–12). Stability analysis via IQC for multilateral tele-control and application to multi-client/multi-coupling physical model system. Proceedings of the 41st Annual Conference of the IEEE Industrial Electronics Society (IECON), Yokohama, Japan.10.1109/IECON.2015.7392623 ↗
28. NIST Net: A Linux-based network emulation tool10.1145/956993.957007 ↗
29. Gassama, L.N., Ishibashi, Y., and Huang, P. (2023, January 8–11). QoE assessment of single-user operation and dual-user operation in remote robot systems with force feedback. Proceedings of the 9th International Conference on Computer and Communications (ICCC), Chengdu, China.10.1109/ICCC59590.2023.10507618 ↗