Distance Assessment by Object Detection—For Visually Impaired Assistive Mechatronic System
Source abstract
Abstract
Techniques for the detection and recognition of objects have experienced continuous development over recent years, as their application and benefits are so very obvious. Whether they are involved in driving a car, environment surveillance and security, or assistive living for people with different disabilities, not to mention advanced robotic surgery, these techniques are almost indispensable. This article presents the research results of a distance assessment using object detection and recognition techniques. The first is a new technique based on low-cost photo cameras and special sign detection. The second is a classic approach based on a LIDAR sensor and an HQ photo camera. Its novelty, in this case, consists of the concept and prototype of the hardware subsystem for high-precision distance measurement, as well as fast and accurate object recognition. The experimentally obtained results are used for the motion control strategy (directional inverse kinematics) of the robotic arm (virtual prototype) component in special assistive devices designed for visually impaired persons. The advantages of the original technical solution, experimentally validated by a prototype system with modern equipment, are the precision and the short time required for the identification and recognition of objects at relatively short distances. The research results obtained, in both the real and virtual experiments, stand as a basis for the further development of the visually impaired mechatronic system prototype using additional ultrasonic sensors, stereoscopic or multiple cameras, and the implementation of machine-learning models for safety-critical tasks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Hand Gesture Recognition Systems · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute of Solid Mechanics, Romanian Academy, 010141 Bucharest, Romania
References (51)
Show source-provided references
1. Fiorini, P. (2018). History of Robots and Robotic Surgery. The SAGES Atlas of Robotic Surgery, Springer.10.1007/978-3-319-91045-1_1 ↗
2. Dionigi, R. (2009). Recent Advances in Liver Surgery. Recent Advances in Liver Surgery, CRC Press.10.1201/9781498712552 ↗
3. Dragne, C., and Chiroiu, V. (2019, January 7–9). Advanced Collision Detection Techniques. Proceedings of the International Multi-Conference on Systems & Structures (SysStruc ’19), Resita, Romania.
4. Knowledge-assisted semantic video object detection10.1109/TCSVT.2005.854238 ↗
5. Pace recognition: Eigenface, elastic matching, and neural nets10.1109/5.628712 ↗
6. Alsanabani, A.A., Ahmed, M.A., and Al Smadi, A.M. (2020, January 25–27). Vehicle Counting Using Detecting-Tracking Combinations: A Comparative Analysis. Proceedings of the 4th International Conference on Video and Image processing, Xi’an, China.10.1145/3447450.3447458 ↗
7. Wu, J., Osuntogun, A., Choudhury, T., Philipose, M., and Rehg, J.M. (2007, January 14–21). A Scalable Approach to Activity Recognition based on Object Use. Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, Rio de Janeiro, Brazil.10.1109/ICCV.2007.4408865 ↗
8. CNN-Based Object Recognition and Tracking System to Assist Visually Impaired People10.1109/ACCESS.2022.3148036 ↗
9. Distance measurement system for autonomous vehicles using stereo camera10.1016/j.array.2020.100016 ↗
10. Salavati, P., and Mohammadi, H.M. (2018, January 25–26). Obstacle Detection Using GoogleNet. Proceedings of the 8th International Conference on Computer and Knowledge Engineering (ICCKE), Masad, Iran.10.1109/ICCKE.2018.8566315 ↗
11. Computing Systems for Autonomous Driving: State of the Art and Challenges10.1109/JIOT.2020.3043716 ↗
12. Li, T., Fang, W., Zhao, G., Gao, F., Wu, Z., Li, R., Fu, L., and Dhupia, J. (2021). An improved binocular localization method for apple based on fruit detection using deep learning. Inf. Process. Agric.
13. Object recognition datasets and challenges: A review10.1016/j.neucom.2022.01.022 ↗
14. Vision systems for harvesting robots: Produce detection and localization
15. Mititelu, E., Vlădăreanu, V., Melinte, O., Barbu, V., Mihai, I., and Pandelea, M. (2017, January 18–19). Deep learning with tree classification for decisional processes on autonomous robots. Proceedings of the SISOM & ACOUSTICS 2017. Session 2—Robotics, Bucharest, Romania.
16. Dual-view 3D object recognition and detection via Lidar point cloud and camera image10.1016/j.robot.2021.103999 ↗
17. Design and Implementation of a Mobile Robot with Autonomous Door Opening Ability10.1007/s40815-018-0557-5 ↗
18. Blind Stereo Image Quality Assessment Based on Binocular Visual Characteristics and Depth Perception10.1109/ACCESS.2020.2992746 ↗
19. Stereoscopic Image Quality Assessment by Considering Binocular Visual Mechanisms10.1109/ACCESS.2018.2869525 ↗
20. Review of multi-view 3D object recognition methods based on deep learning10.1016/j.displa.2021.102053 ↗
21. Transfer Learning and Decision Fusion for Real Time Distortion Classification in Laparoscopic Videos10.1109/ACCESS.2021.3105454 ↗
22. Assessment of importance-based machine learning feature selection methods for aggregate size distribution measurement in a 3D binocular vision system10.1016/j.conbuildmat.2021.124894 ↗
23. Research on computer vision enhancement in intelligent robot based on machine learning and deep learning10.1007/s00521-021-05898-8 ↗
24. Robust depth-based object tracking from a moving binocular camera10.1016/j.sigpro.2014.08.041 ↗
25. Brainport: An alternative input to the brain10.1142/S0219635205000914 ↗
26. (2022, February 28). Google Patents. Available online: https://patents.google.com/patent/US6430450B1/en.
27. (2022, March 03). OrCam Read. Available online: https://www.orcam.com/en/read/.
28. Pandelea, M., Todirite, I., and Iliescu, M. (2020, January 27–28). Customized Assistive System Design for Visually Impaired People. Proceedings of the 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4), London, UK.10.1109/WorldS450073.2020.9210356 ↗
29. Saputra, M.R.U., and Santosa, P.I. (2014, January 9–12). Obstacle Avoidance for Visually Impaired Using Auto-Adaptive Thresholding on Kinect’s Depth Image. Proceedings of the 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops, Bali, Indonesia.10.1109/UIC-ATC-ScalCom.2014.108 ↗
30. Poggi, M., and Mattoccia, S. (2016, January 27–30). A wearable mobility aid for the visually impaired based on embedded 3D vision and deep learning. Proceedings of the 2016 IEEE Symposium on Computers and Communication (ISCC), Messina, Italy.10.1109/ISCC.2016.7543741 ↗
31. Xiao, J., Ramdath, K., Iosilevish, M., Sigh, D., and Tsakas, A. (2013, January 19–21). A low-cost outdoor assistive navigation system for blind people. Proceedings of the IEEE 8th Conference on Industrial Electronics and Applications (ICIEA), Melbourne, Australia.
32. Object Detection using Ultrasonic Sensor
33. Moving Object Detection Using Ultrasonic Radar with Proper Distance, Direction, and Object Shape Analysis
34. Ecemis, I.M., and Gaudiano, P. (1999, January 8–9). Object recognition with ultrasonic sensors. Proceedings of the 1999 IEEE International Sympo-sium on Computational Intelligence in Robotics and Automation. CIRA’99 (Cat. No.99EX375), Monterey, CA, USA.
35. (2022, February 20). Basler Line Scan Cameras. Available online: https://www.baslerweb.com/en/products/cameras/line-scan-cameras/.
36. 3D TRUS guided robot assisted prostate brachytherapy
37. Localization of linked 125I seeds in postimplant TRUS images for prostate brachytherapy dosimetry10.1016/j.ijrobp.2005.02.041 ↗
38. Photoacoustic imaging in biomedicine10.1063/1.2195024 ↗
39. An analysis of elastographic contrast-to-noise ratio10.1016/S0301-5629(98)00047-7 ↗
40. Yi, Y., and Dong, L. (2015, January 15–17). A design of blind-guide crutch based on multi-sensors. Proceedings of the 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Zhangjiajie, China.
41. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
42. (2022, May 15). Introduction to YOLO Algorithm for Object Detection. Available online: https://www.section.io/engineering-education/introduction-to-yolo-algorithm-for-object-detection/.
43. Real-Time Object Detection for LiDAR Based on LS-R-YOLOv4 Neural Network10.1155/2021/5576262 ↗
44. Han, J., Liao, Y., Zhang, J., Wang, S., and Li, S. (2018). Target fusion detection of LiDAR and camera based on the improved YOLO algorithm. Mathematics, 6.10.3390/math6100213 ↗
45. Llados, J., Marti, E., and Lopez-Krahe, J. (1999, January 20–22). A Hough-based method for hatched pattern detection in maps and diagrams. Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR ’99 (Cat. No.PR00318), Bangalore, India.10.1109/ICDAR.1999.791829 ↗
46. Dragne, C. (2022, April 03). “Directional Kinematics—First Step in Robotic Movement”, Analele Universităţii “Eftimie Murgu”, 2019, Reşiţa, Anul XXVI, Nr. 1. Available online: https://www.researchgate.net/publication/359920311_Directional_kinematics_first_step_in_robotic_movement.
47. Li, Y., Wu, B., Jiang, Y., Li, Z., and Xia, S.T. (2020). Backdoor learning: A survey. arXiv.
48. (2022, February 02). Wikipedia. Available online: https://en.wikipedia.org/wiki/Object_detection.
49. (2022, March 12). Manufacturing Automation. Available online: http://magazine.automationmag.com/publication/?m=32396&i=570926&p=1&ver=html5.
50. (2022, April 23). Mathworks. Available online: https://www.mathworks.com/help/vision/ref/showmatchedfeatures.html.
51. (2022, March 07). Solidworks Software. Available online: https://www.solidworks.com/.