Computer-Vision Based Object Detection and Recognition for Service Robot in Indoor Environment
Source abstract
Abstract
The near future has been envisioned as a collaboration of humans with mobile robots to help in the day-to-day tasks. In this paper, we present a viable approach for a real-time computer vision based object detection and recognition for efficient indoor navigation of a mobile robot. The mobile robotic systems are utilized mainly for home assistance, emergency services and surveillance, in which critical action needs to be taken within a fraction of second or real-time. The object detection and recognition is enhanced with utilization of the proposed algorithm based on the modification of You Look Only Once (YOLO) algorithm, with lesser computational requirements and relatively smaller weight size of the network structure. The proposed computer-vision based algorithm has been compared with the other conventional object detection/recognition algorithms, in terms of mean Average Precision (mAP) score, mean inference time, weight size and false positive percentage. The presented framework also makes use of the result of efficient object detection/recognition, to aid the mobile robot navigate in an indoor environment with the utilization of the results produced by the proposed algorithm. The presented framework can be further utilized for a wide variety of applications involving indoor navigation robots for different services.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (77)
Show source-provided references
1. Selecting social robot by understanding human–Robot interaction
2. Person-following by autonomous robots: A categorical overview10.1177/0278364919881683 ↗
3. A preliminary study on convolutional neural networks for camera model identification10.2352/ISSN.2470-1173.2017.7.MWSF-327 ↗
4. You only look once: unified, real-time object detection
5. Natural corners-based SLAM in unknown indoor environment
6. Efficient particle filter algorithm for ultrasonic sensor-based 2D range-only simultaneous localisation and mapping application10.1049/iet-wss.2011.0129 ↗
7. Finding disaster victims: A sensory system for robot-assisted 3D mapping of urban search and rescue environments
8. Search and rescue robots: The civil protection teams of the future
9. Rich feature hierarchies for accurate object detection and semantic segmentation
10. Fast R-CNN
11. Automatic segmentation and area calculation of optic disc in ophthalmic images
12. SSD: Single shot multibox detector
13. Faster R-CNN: Towards real-time object detection with region proposal networks
14. YOLOv3: An incremental improvement
15. Design framework for general purpose object recognition on a robotic platform
16. Human leg detection from depth sensing
17. Semantic map augmentation for robot navigation: A learning approach based on visual and depth data
18. A novel three-dimensional object detection with the modified You only look once method10.1177/1729881418765507 ↗
19. A deep learning tennis ball collection robot and the implementation on nvidia jetson tx1 board
20. Data-driven, 3-D classification of person-object relationships and semantic context clustering for robotics and AI applications
21. Indoor room identify and mapping with virtual based SLAM using furnitures and household objects relationship based on CNNs
22. Factorized convolutional neural networks
23. F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally et al., “SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size,” arXiv Prepr. arXiv1602.07360, 2016.
24. A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang et al., “Mobilenets: Efficient convolutional neural networks for mobile vision applications,” arXiv Prepr. arXiv1704.04861, 2017.
25. Ravulavaru · Google Cloud AI Services Quick Start Guide: Build Intelligent Applications with Google Cloud AI Services · 2018 · 113
26. Koul · Mobile, and Edge: Real-World AI & Computer-Vision Projects Using Python, Keras & TensorFlow · 2019
27. Mane · Switzerland: Springer · 2019 · 808 · 275
28. Real-time, cloud-based object detection for unmanned aerial vehicles
29. A mobile service robot for the hospital and home environment
30. Indoor mobile robot localization based on a particle filter approach
31. Vision based office assistant robot system for indoor office environment
32. Object detection and tracking for autonomous navigation in dynamic environments10.1177/0278364910365417 ↗
33. Tracking control of mobile robots localized via chained fusion of discrete and continuous epipolar geometry, IMU and odometry10.1109/TSMCB.2012.2227720 ↗
34. Localization and navigation for indoor mobile robot based on ROS
35. Hybrid method for the navigation of mobile robot using fuzzy logic and spiking neural networks10.5815/ijisa.2014.12.01 ↗
36. Adaptive neural dynamic compensator for mobile robots in trajectory tracking control10.1109/TLA.2011.6030965 ↗
37. H. Eraqi, Y. EmadEldin and M. Moustafa, “Reactive collision avoidance using evolutionary neural networks,” arXiv Prepr. arXiv1609.08414, 2016.10.5220/0006084902510257 ↗
38. O. Mohareri, “Mobile robot trajectory tracking using neural networks,” M.S. Thesis, Department of Electrical Engineering, American University of Sharjah, Sharjah, UAE, 2009.
39. Bounding box regression with uncertainty for accurate object detection
40. M. Kisantal, Z. Wojna, J. Murawski, J. Naruniec and K. Cho, “Augmentation for small object detection,” arXiv Prepr. arXiv1902.07296, 2019.10.5121/csit.2019.91713 ↗
41. Libra R-CNN: Towards balanced learning for object detection
42. Moving object detection method via ResNet−18 with encoder--decoder structure in complex scenes10.1109/ACCESS.2019.2931922 ↗
43. Detnet: design backbone for object detection
44. Mobilenet-SSDv2: An improved object detection model for embedded systems
45. DF-SSD: An improved SSD object detection algorithm based on DenseNet and feature fusion10.1109/ACCESS.2020.2971026 ↗
46. Foveabox: Beyond anchor-based object detection10.1109/TIP.2020.3002345 ↗
47. Efficient online structured output learning for keypoint-based object tracking
48. Computer vision based object recognition principles in education
49. Multi-scale location-aware kernel representation for object detection
50. Feature representation for statistical-learning-based object detection: A review10.1016/j.patcog.2015.04.018 ↗
51. Contextual priming for object detection10.1023/A:1023052124951 ↗
52. Deformable DETR: Deformable transformers for end-to-end object detection10.31579/2693-4787/004 ↗
53. Learning data augmentation strategies for object detection
54. Overcoming classifier imbalance for long-tail object detection with balanced group softmax
55. Improved object detection with iterative localization refinement in convolutional neural networks10.1109/TCSVT.2017.2730258 ↗
56. Learning surf cascade for fast and accurate object detection
57. Sequential context encoding for duplicate removal
58. Accelerating very deep convolutional networks for classification and detection10.1109/TPAMI.2015.2502579 ↗
59. Li · Recent Trends in Intelligent Computing, Communication and Devices · 2020 · 277
60. Object detection in optical remote sensing images: A survey and a new benchmark10.1016/j.isprsjprs.2019.11.023 ↗
61. From handcrafted to deep features for pedestrian detection: A survey
62. Vision meets robotics: the kitti dataset10.1177/0278364913491297 ↗
63. Object detection using a max-margin hough transform
64. Max-margin object detection
65. Reconstructing pascal voc
66. Backstepping-based cooperative and adaptive tracking control design for a group of underactuated AUVs in horizontal plan10.1080/00207179.2013.868605 ↗
67. Adaptive and intelligent navigation of autonomous planetary rovers—A survey
68. Software development for automated system of recording the range of motion of the shoulder joint during rehabilitation
69. Development of aFree-navigation mobile robot system based on a digital image processing methodology
70. Wheeled robot control based on gesture recognition using the kinect sensor
71. Human gesture imitation on NAO humanoid robot using kinect based on inverse kinematics method
72. Ultimate SLAM? combining events, images, and IMU for robust visual SLAM in HDR and high-speed scenarios10.1109/LRA.2018.2793357 ↗
73. M. Eck, “Simultaneous 2D Localization and 3D Mapping on a mobile Robot with Time-of-Flight Sensors,” M.S. thesis, University of Applied Sciences, Koblenz, 2013.
74. Flower pollination algorithm: A novel approach for multiobjective optimization10.1080/0305215X.2013.832237 ↗
75. A tutorial on graph-based SLAM10.1109/MITS.2010.939925 ↗
76. The MAI: A robot for/by everyone
77. R-FCN: Object detection via region-based fully convolutional networks