Robotics Classification of Domain Knowledge Based on a Knowledge Graph for Home Service Robot Applications
Source abstract
Abstract
The representation and utilization of environmental information by service robots has become increasingly challenging. In order to solve the problems that the service robot platform has, such as high timeliness requirements for indoor environment recognition tasks and the small scale of indoor scene data, a method and model for rapid classification of household environment domain knowledge is proposed, which can achieve high recognition accuracy by using a small-scale indoor scene and tool dataset. This paper uses a knowledge graph to associate data for home service robots. The application requirements of knowledge graphs for home service robots are analyzed to establish a rule base for the system. A domain ontology of the home environment is constructed for use in the knowledge graph system, and the interior functional areas and functional tools are classified. This designed knowledge graph contributes to the state of the art by improving the accuracy and efficiency of service decision making. The lightweight network MobileNetV3 is used to pre-train the model, and a lightweight convolution method with good feature extraction performance is selected. This proposal adopts a combination of MobileNetV3 and transfer learning, integrating large-scale pre-training with fine-tuning for the home environment to address the challenge of limited data for home robots. The results show that the proposed model achieves higher recognition accuracy and recognition speed than other common methods, meeting the work requirements of service robots. With the Scene15 dataset, the proposed scheme has the highest recognition accuracy of 0.8815 and the fastest recognition speed of 63.11 microseconds per sheet.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Automated Systems · Optimization and Search Problems · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Automation, Beijing Information Science & Technology University, Beijing 100192, China
School of Information Science and Engineering, Yanshan University, Qinhuangdao 066004, China
Funding
National Natural Science Foundation of China · Major Research Plan of the National Natural Science Foundation of China · Young Backbone Teacher Support Plan of Beijing Information Science &Technology University
References (38)
Show source-provided references
1. An overview of current situations of robot industry development10.1051/itmconf/20181703019 ↗
2. A visual-attention-based 3D mapping method for mobile robots
3. Ye, C., Yang, Y., Mao, R., Fermüller, C., and Aloimonos, Y. (June, January 29). What can i do around here? deep functional scene understanding for cognitive robots. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989535 ↗
4. An indoor scene classification method for service robot Based on CNN feature
5. Srivastava, S., Li, C., Lingelbach, M., Martín-Martín, R., Xia, F., Vainio, K.E., Lian, Z., Gokmen, C., Buch, S., and Liu, K. (2021, January 8–11). Behavior: Benchmark for everyday household activities in virtual, interactive, and ecological environments. Proceedings of the Conference on Robot Learning, London, UK.
6. A Fast Algorithm for Affordance Detection of Household Tool Parts Based on Structured Random Forest10.3788/AOS201737.0215001 ↗
7. Learning depth-aware deep representations for robotic perception10.1109/LRA.2016.2637444 ↗
8. Park, W., Han, M., Son, J.-W., and Kim, S.-J. (2017, January 19–22). Design of scene knowledge base system based on domain ontology. Proceedings of the 2017 19th International Conference on Advanced Communication Technology (ICACT), Pyeongchang, Republic of Korea.10.23919/ICACT.2017.7890152 ↗
9. Hao, Q., Li, Y., Wang, L.M., and Wang, M. (2017, January 13–16). An ontology-based data organization method. Proceedings of the 2017 Fifth International Conference on Advanced Cloud and Big Data (CBD), Shanghai, China.10.1109/CBD.2017.31 ↗
10. Peng, Z., Song, H., Zheng, X., and Yi, L. (2020, January 27–29). Construction of hierarchical knowledge graph based on deep learning. Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China.10.1109/ICAICA50127.2020.9181920 ↗
11. Knowledge graphs in manufacturing and production: A systematic literature review10.1109/ACCESS.2021.3070395 ↗
12. Yang, Y., Wu, Z., and Zhu, X. (2016, January 23–25). Semi-automatic metadata annotation of web of things with knowledge base. Proceedings of the 2016 IEEE International Conference on Network Infrastructure and Digital Content (IC-NIDC), Beijing, China.10.1109/ICNIDC.2016.7974549 ↗
13. Representations for robot knowledge in the KnowRob framework10.1016/j.artint.2015.05.010 ↗
14. Autonomous cognition and planning of robot service based on ontology in intelligent space environment
15. Autonomous cognition and personalized selection of robot services based on emotion-space-time information
16. Ontology-based humanoid cognition and reasoning of object attributes
17. From activity recognition to intention recognition for assisted living within smart homes10.1109/THMS.2016.2641388 ↗
18. Multi-modal knowledge graph construction and application: A survey10.1109/TKDE.2022.3224228 ↗
19. Domain knowledge graph-based research progress of knowledge representation10.1007/s00521-020-05057-5 ↗
20. Zhou, L., Cen, J., Wang, X., Sun, Z., Lam, T.L., and Xu, Y. (October, January 27). Borm: Bayesian object relation model for indoor scene recognition. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9636024 ↗
21. Pereira, R., Garrote, L., Barros, T., Lopes, A., and Nunes, U.J. (October, January 27). A deep learning-based indoor scene classification approach enhanced with inter-object distance semantic features. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9636242 ↗
22. Deep generative modeling for scene synthesis via hybrid representations10.1145/3381866 ↗
23. Huang, S., Usvyatsov, M., and Schindler, K. (2020, January 25–29). Indoor scene recognition in 3D. Proceedings of the 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Las Vegas, NV, USA.10.1109/IROS45743.2020.9341580 ↗
24. Chen, J., Ge, X., Li, W., and Peng, L. (2021, January 11–16). Construction of spatiotemporal knowledge graph for emergency decision making. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.10.1109/IGARSS47720.2021.9553867 ↗
25. Semantic-aware scene recognition10.1016/j.patcog.2020.107256 ↗
26. Miao, B., Zhou, L., Mian, A.S., Lam, T.L., and Xu, Y. (October, January 27). Object-to-scene: Learning to transfer object knowledge to indoor scene recognition. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9636700 ↗
27. Brock, A., De, S., Smith, S.L., and Simonyan, K. (2021, January 18–24). High-performance large-scale image recognition without normalization. Proceedings of the International Conference on Machine Learning, Online.
28. Srinivas, A., Lin, T.-Y., Parmar, N., Shlens, J., Abbeel, P., and Vaswani, A. (2021, January 19–25). Bottleneck transformers for visual recognition. Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01625 ↗
29. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las vegas, NV, USA.
30. Radosavovic, I., Kosaraju, R.P., Girshick, R., He, K., and Dollár, P. (2020, January 13–19). Designing network design spaces. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01044 ↗
31. Zhang, H., Wu, C., Zhang, Z., Zhu, Y., Lin, H., Zhang, Z., Sun, Y., He, T., Mueller, J., and Manmatha, R. (2022, January 18–24). Resnest: Split-attention networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPRW56347.2022.00309 ↗
32. Iandola, F.N. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv.
33. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv.
34. Chollet, F. (2017, January 21–26). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
35. Zoph, B. (2016). Neural architecture search with reinforcement learning. arXiv.
36. Classification of high-spatial-resolution remote sensing scenes method using transfer learning and deep convolutional neural network10.1109/JSTARS.2020.2988477 ↗
37. Satellite and scene image classification based on transfer learning and fine tuning of ResNet5010.1155/2021/5843816 ↗
38. Towards effective codebookless model for image classification10.1016/j.patcog.2016.03.004 ↗