journal article·2021-08-31Open access

Ontology-Based Framework for Cooperative Learning of 3D Object Recognition

Parkpoom Chaisiriprasert, Karn Yongsiriwit, Matthew N. Dailey, Chutiporn Anutariya

Applied Sciences· Volume 11· Issue 17

Abstract

Advanced service robots are not, as of yet, widely adopted, partly due to the effectiveness of robots’ object recognition capabilities, the issue of object heterogeneity, a lack of knowledge sharing, and the difficulty of knowledge management. To encourage more widespread adoption of service robots, we propose an ontology-based framework for cooperative robot learning that takes steps toward solving these problems. We present a use case of the framework in which multiple service robots offload compute-intensive machine vision tasks to cloud infrastructure. The framework enables heterogeneous 3D object recognition with the use of ontologies. The main contribution of our proposal is that we use the Unified Robot Description Format (URDF) to represent robots, and we propose the use of a new Robotic Object Description (ROD) ontology to represent the world of objects known by the collective. We use the WordNet database to provide a common understanding of objects across various robotic applications. With this framework, we aim to give a widely distributed group of robots the ability to cooperatively learn to recognize a variety of 3D objects. Different robots and different robotic applications could share knowledge and benefit from the experience of others via our framework. The framework was validated and then evaluated using a proof-of-concept, including a Web application integrated with the ROD ontology and the WordNet API for semantic analysis. The evaluation demonstrates the feasibility of using an ontology-based framework and using the Ontology Web Language (OWL) to provide improved knowledge management while enabling cooperative learning between multiple robots.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotics and Automated Systems · Modular Robots and Swarm Intelligence · Cognitive Computing and Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Innovation Technology, Rangsit University, Pathum Thani 12000, Thailand

School of Engineering and Technology, Asian Institute of Technology, Pathum Thani 12120, Thailand

References (39)

Show source-provided references
1. Cooperative mobile robotics: Antecedents and directions10.1109/IROS.1995.525801 ↗
2. Forlizzi, J., and DiSalvo, C.F. (2016, January 2–3). Service Robots in the Domestic Environment. Proceedings of the ACM Sigchi/Sigart Conference on Human-Robot Interaction, Salt Lake City, UT, USA.
3. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.H., Konwinski, A., Lee, G., Patterson, D.A., Rabkin, A., and Zaharia, M. (2009). Above the Clouds: A Berkeley View of Cloud Computing, EECS Department, University of California. Technical Report UCB/EECS-2009-28.
4. Kang, Y., Kim, D., and Kim, K. (2019, January 25–27). URDF Generator for Manipulator Robot. Proceedings of the Third IEEE International Conference on Robotic Computing (IRC), Naples, Italy.10.1109/IRC.2019.00101 ↗
5. Jordan, S., Haidegger, T., Kovacs, L., Felde, I., and Rudas, I. (2013, January 8–10). The Rising Prospects of Cloud Robotic Applications. Proceedings of the 2013 IEEE 9th International Conference on Computational Cybernetics (ICCC), Tihany, Hungary.10.1109/ICCCyb.2013.6617612 ↗
6. A Survey of Research on Cloud Robotics and Automation10.1109/TASE.2014.2376492 ↗
7. Chen, Y., Du, Z., and Garciía-Acosta, M. (2010, January 4–5). Robot as a Service in Cloud Computing. Proceedings of the 2010 Fifth IEEE International Symposium on Service Oriented System Engineering (SOSE), Nanjing, China.10.1109/SOSE.2010.44 ↗
8. Du, Z., Yang, W., Chen, Y., Sun, X., Wang, X., and Xu, C. (2011, January 23–27). Design of a Robot Cloud Center. Proceedings of the 2011 10th International Symposium on Autonomous Decentralized Systems (ISADS), Tokyo, Japan.10.1109/ISADS.2011.36 ↗
9. Rocha, L.A., Olivi, L., Feliciano, G., Neto, F.P., Rodrigues, D., Cardozo, E., and Guimarães, E.G. (2011, January 12–14). A Cloud Computing Environment for Supporting Networked Robotics Applications. Proceedings of the IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing, Sydney, NSW, Australia.
10. Arumugam, R., Enti, V.R., Liu, B., Wu, X., Baskaran, K., Foong, F.K., Kumar, A.S., Kang, D.M., and Goh, W.K. (2010, January 3–7). DAvinCi: A Cloud Computing Framework for Service Robots. Proceedings of the IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.10.1109/ROBOT.2010.5509469 ↗
11. Chen, Y.-Y., Wang, J.-F., Lin, P.-C., Shih, P.-Y., Tsai, H.-C., and Kwan, D.-Y. (2011, January 21–24). Human-Robot Interaction based on Cloud Computing Infrastructure for Senior Companion. Proceedings of the TENCON 2011—2011 IEEE Region 10 Conference, Bali, Indonesia.
12. Tenorth, M., Kamei, K., Satake, S., Miyashita, T., and Hagita, N. (2013, January 3–7). Building Knowledge-Enabled Cloud Robotics Applications using the Ubiquitous Network Robot Platform. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Tokyo, Japan.10.1109/IROS.2013.6697184 ↗
13. Kehoe, B., Matsukawa, A., Candido, S., Kuffner, J., and Goldberg, K. (2013, January 6–10). Cloud-Based Robot Grasping with the Google Object Recognition Engine. Proceedings of the 2013 IEEE International Conference on Robotics and Automation (ICRA), Karlsruhe, Germany.10.1109/ICRA.2013.6631180 ↗
14. Turnbull, L., and Samanta, B. (2013, January 4–7). Cloud Robotics: Formation Control of a Multi Robot System Utilizing Cloud Infrastructure. Proceedings of the 2013 Proceedings of IEEE Southeastcon, Jacksonville, FL, USA.10.1109/SECON.2013.6567422 ↗
15. Sun, X., Lu, F., and Li, Q. (2017, January 20–22). The Task Reasoning of Service Robot based on Ontology Technology. Proceedings of the Chinese Automation Congress (CAC), Jinan, China.10.1109/CAC.2017.8243397 ↗
16. Wongpatikaseree, K., Ikeda, M., Buranarach, M., Supnithi, T., Lim, A.O., and Tan, Y. (2012, January 8–10). Activity Recognition Using Context-Aware Infrastructure Ontology in Smart Home Domain. Proceedings of the Seventh International Conference on Knowledge, Information and Creativity Support Systems, Melbourne, VIC, Australia.10.1109/KICSS.2012.26 ↗
17. RehabRobo-Onto: Design, development and maintenance of a rehabilitation robotics ontology on the cloud10.1016/j.rcim.2014.08.010 ↗
18. Semantics-based platform for context-aware and personalized robot interaction in the internet of robotic things10.1016/j.jss.2018.11.022 ↗
19. Prestes, E., Fiorini, S.R., and Carbonera, J. (2014, January 18). Core Ontology for Robotics and Automation. Proceedings of the Standardized Knowledge Representation and Ontologies for Robotics and Automation, Workshop on the, Chigago, IL, USA.
20. Towards a core ontology for robotics and automation10.1016/j.robot.2013.04.005 ↗
21. Carbonera, J.L., Fiorini, S.R., Prestes, E., Jorge, V.A.M., Abel, M., Madhavan, R., Locoro, A., Gonçalves, P.J.S., Haidegger, T., and Barreto, M.E. (2013, January 3–7). Defining Positioning in a Core Ontology for Robotics. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.10.1109/IROS.2013.6696603 ↗
22. Olszewska, J.I., Barreto, M.E., Bermejo-Alonso, J., Carbonera, J.L., Chibani, A., Fiorini, S.R., Gonçalves, P.J.S., Habib, M.K., Khamis, A., and Alarcos, A.O. (2017, January 28). Ontology for Autonomous Robotics. Proceedings of the 26th IEEE International Symposium on Robot and Human Interactive Communication, RO-MAN 2017, Lisbon, Portugal.10.1109/ROMAN.2017.8172300 ↗
23. Ahrens, K., Chung, S.F., and Huang, C. (2003, January 11). Conceptual Metaphors: Ontology-based Representation and Corpora Driven Mapping Principles. Proceedings of the ACL Workshop on the Lexicon and Figurative Language, Sapporo, Japan.10.3115/1118975.1118980 ↗
24. Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler, R., and Andrew, Y.N. (2009, January 17). ROS: An open-source robot operating system. Proceedings of the 2009 IEEE International Conference on Robotics and Automation (ICRA2009), Kobe, Japan.
25. (2019, April 21). ROS.org, Unified Robot Description Format (URDF). Available online: http://wiki.ros.org/urdf.
26. Miller, G.A. (1995). WordNet: A Lexical Database for English. Human Language Technology, Proceedings of a Workshop held at Plainsboro, ACM.10.3115/1075812.1075938 ↗
27. An Ontology for Human-Robot Collaboration10.1016/j.procir.2020.04.045 ↗
28. Ontology-based knowledge management with verbal interaction for command interpretation and execution by home service robots10.1016/j.robot.2021.103763 ↗
29. Knowledge Representation for Culturally Competent Personal Robots: Requirements, Design Principles, Implementation, and Assessment10.1007/s12369-019-00519-w ↗
30. Diab, M., Akbari, A., Ud Din, M., and Rosell, J. (2019). PMK—A Knowledge Processing Framework for Autonomous Robotics Perception and Manipulation. Sensors, 19.10.3390/s19051166 ↗
31. Rusu, R.B., and Cousins, S. (2011, January 9–13). 3D is Here: Point Cloud Library (PCL). Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.10.1109/ICRA.2011.5980567 ↗
32. Rusu, R.B., Blodow, N., Marton, Z., Soos, A., and Beetz, M. (2007, January 29). Towards 3d Object Maps for Autonomous Household Robots. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA.
33. Yuan, C., Yu, X., and Luo, Z. (2016, January 11–12). 3D Point Cloud Matching based on Principal Component Analysis and Iterative Closest Point Algorithm. Proceedings of the 2016 International Conference on Audio, Language and Image Processing (ICALIP), Shanghai, China.10.1109/ICALIP.2016.7846655 ↗
34. Ligon, J., Bein, D., Ly, P., and Onesto, B. (2018, January 8–10). 3D Point Cloud Processing using Spin Images for Object Detection. Proceedings of the 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA.10.1109/CCWC.2018.8301688 ↗
35. Three-Dimensional Point Cloud Object Detection Using Scene Appearance Consistency Among Multi-View Projection Directions10.1109/TCSVT.2019.2957821 ↗
36. Ren, T., and Wu, R. (2020, January 14–16). An Acceleration Algorithm of 3D Point Cloud Registration based on Iterative Closet Point. Proceedings of the 2020 Asia-Pacific Conference on Image Processing, Electronics and Computers (IPEC), Dalian, China.10.1109/IPEC49694.2020.9114965 ↗
37. Dumic, E., Battisti, F., Carli, M., and da Silva Cruz, L.A. (2021, January 18–21). Point Cloud Visualization Methods: A Study on Subjective Preferences. Proceedings of the 2020 28th European Signal Processing Conference (EUSIPCO), Amsterdam, The Netherlands.10.23919/Eusipco47968.2020.9287504 ↗
38. Chacón, A., Ponsa, P., and Angulo, C. (2021). Usability Study through a Human-Robot Collaborative Workspace Experience. Designs, 5.10.3390/designs5020035 ↗
39. TOMS: A Linked Open Data System for Collaboration and Distribution of Cultural Heritage Artifact Collections of National Museums in Thailand10.1007/s00354-019-00063-1 ↗