journal article·2023-09-06Open access

Towards Indoor Suctionable Object Classification and Recycling: Developing a Lightweight AI Model for Robot Vacuum Cleaners

Qian Huang

Applied Sciences· Volume 13· Issue 18

Abstract

Robot vacuum cleaners have gained widespread popularity as household appliances. One significant challenge in enhancing their functionality is to identify and classify small indoor objects suitable for safe suctioning and recycling during cleaning operations. However, the current state of research faces several difficulties, including the lack of a comprehensive dataset, size variation, limited visual features, occlusion and clutter, varying lighting conditions, the need for real-time processing, and edge computing. In this paper, I address these challenges by investigating a lightweight AI model specifically tailored for robot vacuum cleaners. First, I assembled a diverse dataset containing 23,042 ground-view perspective images captured by robot vacuum cleaners. Then, I examined state-of-the-art AI models from the existing literature and carefully selected three high-performance models (Xception, DenseNet121, and MobileNet) as potential model candidates. Subsequently, I simplified these three selected models to reduce their computational complexity and overall size. To further compress the model size, I employed post-training weight quantization on these simplified models. In this way, our proposed lightweight AI model strikes a balance between object classification accuracy and computational complexity, enabling real-time processing on resource-constrained robot vacuum cleaner platforms. I thoroughly evaluated the performance of the proposed AI model on a diverse dataset, demonstrating its feasibility and practical applicability. The experimental results show that, with a small memory size budget of 0.7 MB, the best AI model is L-w Xception 1, with a width factor of 0.25, whose resultant object classification accuracy is 84.37%. When compared with the most accurate state-of-the-art model in the literature, this proposed model accomplished a remarkable memory size reduction of 350 times, while incurring only a slight decrease in classification accuracy, i.e., approximately 4.54%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · COVID-19 diagnosis using AI

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Architecture, College of Arts and Media, Southern Illinois University Carbondale, Carbondale, IL 62901, USA

References (33)

Show source-provided references
1. Huang, Q., Lu, C., and Chen, K. (2017). Big Data Analytics for Sensor-Network Collected Intelligence, Elsevier.
2. Jayaram, R., and Dandge, R. (2023, July 13). Optimizing Cleaning Efficiency of Robotic Vacuum Cleaner. TATA ELXSI Report. Available online: https://www.tataelxsi.com/.
3. Artificial Intelligence, Machine Learning and Deep Learning in Advanced Robotics, a Review10.1016/j.cogr.2023.04.001 ↗
4. Weight-Quantized SqueezeNet for Resource-Constrained Robot Vacuums for Indoor Obstacle Classification10.3390/ai3010011 ↗
5. High-Performance and Lightweight AI Model for Robot Vacuum Cleaners with Low Bitwidth Strong Non-Uniform Quantization10.3390/ai4030029 ↗
6. Amitha, S., Raj, P.N., Sonika, H.P., Urs, S., Tejashwini, B., Kulkarni, S.A., and Jha, V. (2020, January 16–17). Segregated Waste Collector with Robotic Vacuum Cleaner using Internet of Things. Proceedings of the IEEE International Symposium on Sustainable Energy, Signal Processing and Cyber Security, Gunupur Odisha, India.10.1109/iSSSC50941.2020.9358839 ↗
7. Calaiaro, J. (2022). AI-Guided Robots Are Ready to Sort your Recyclables. IEEE Spectrum.
8. Gusson, M. (2023, July 13). Robotic Vacuum Cleaner Designed for Circular Economy. Available online: https://umu.diva-portal.org/smash/get/diva2:1577399/FULLTEXT01.pdf.
9. Neuman, S., Plancher, B., Duisterhof, B.P., Krishnan, S., Banbury, C., Mazumder, M., Prakash, S., Jabbour, J., Faust, A., and de Croon, G.C.H.E. (2022, January 13–15). Tiny Robot Learning: Challenges and Directions for Machine Learning in Resource-Constrained Robots. Proceedings of the IEEE 4th International Conference on Artificial Intelligence Circuits and Systems, Incheon, Republic of Korea.10.1109/AICAS54282.2022.9870000 ↗
10. Bao, L., and Lv, C. (2022, February 13). Ecovacs Robotics: The AI Robotic Vacuum Cleaner Powered by TensorFlow. Available online: https://blog.tensorflow.org/2020/01/ecovacs-robotics-ai-robotic-vacuum.html.
11. Althnian, A., AlSaeed, D., Al-Baity, H., Samha, A., Dris, A.B., Alzakari, N., Abou Elwafa, A., and Kurdi, H. (2021). Impact of Dataset Size on Classification Performance: An Empirical Evaluation In the Medical Domain. Appl. Sci., 2021.10.3390/app11020796 ↗
12. Edge robotics: Are we ready? An experimental evaluation of current vision and future directions10.1016/j.dcan.2022.04.032 ↗
13. Sami, S., Dai, Y., Tan, S.R.X., Roy, N., and Han, J. (2020, January 16–19). Spying with Your Robot Vacuum Cleaner: Eavesdropping via Lidar Sensors. Proceedings of the 18th Conference on Embedded Networked Sensor Systems, Virtual.10.1145/3384419.3430781 ↗
14. Schneider, M., Amann, R., and Mitsantisuk, C. (2021, January 8–11). Waste object classification with AI on the edge accelerators. Proceedings of the IEEE International Conference on Mechatronics, Takamatsu, Japan.10.1109/ICM46511.2021.9385682 ↗
15. Deep Learning Based Robot for Automatically Picking up Garbage on the Grass10.1109/TCE.2018.2859629 ↗
16. Intelligent Waste Classification System Using Deep Learning Convolutional Neural Network10.1016/j.promfg.2019.05.086 ↗
17. A Vision Based Approach to Localize Waste Objects and Geometric Features Exaction for Robotic Manipulation10.1016/j.procs.2023.01.113 ↗
18. Stephenn, L., Cabatuan, M.K., Sybingco, E., Dadios, E.P., and Calilung, E.J. (December, January 29). Common Garbage Classification Using Mobilenet. Proceedings of the IEEE 10th International Conference on Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management, Baguio City, Philippines.
19. Garbage classification system based on improved ShuffleNet v210.1016/j.resconrec.2021.106090 ↗
20. Scrapnet: An Efficient Approach to Trash Classification10.1109/ACCESS.2021.3111230 ↗
21. Office Garbage Intelligent Classification Based on Inception-V3 Transfer Learning Model10.1088/1742-6596/1487/1/012008 ↗
22. A Novel Multi-Branch Channel Expansion Network for Garbage Image Classification10.1109/ACCESS.2020.3016116 ↗
23. Object Detection for Sweeping Robots in Home Scenes (ODSR-IHS): A Novel Benchmark Dataset10.1109/ACCESS.2021.3053546 ↗
24. (2023, July 30). STM32F7 Series. Available online: www.st.com/en/microcontrollers-microprocessors/stm32f7-series.html.
25. Rukundo, O. (2023). Effects of Image Size on Deep Learning. Electronics, 12.10.3390/electronics12040985 ↗
26. Talebi, H., and Milanfar, P. (2021, January 11–17). Learning to Resize Images for Computer Vision Tasks. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00055 ↗
27. Kulkarni, U., Hosamani, A.S., Masur, A.S., Hegde, S., Vernekar, G.R., and Chandana, K.S. (2022, January 13–15). A Survey on Quantization Methods for Optimization of Deep Neural Networks. Proceedings of the International Conference on Automation, Computing and Renewable Systems (ICACRS), Pudukkottai, India.10.1109/ICACRS55517.2022.10028742 ↗
28. Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., and Kalenichenko, D. (2018, January 18–23). Quantization and Training of Neural Networks for Efficient Integer-arithmetic-only Inference. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00286 ↗
29. (2023, July 30). TensorFlow Model Conversion Overview. Available online: https://www.tensorflow.org/lite/models/convert.
30. Chollet, F. (2023, July 30). Keras. Available online: https://github.com/fchollet/keras.
31. Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2–4). Tensorflow: A system for large-scale machine learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation, Savannah, GA, USA.
32. (2023, July 30). Available online: https://developer.nvidia.com/cuda-toolkit.
33. Kingma, D., and Jimmy, B. (2014). Adam: A method for stochastic optimization. arXiv.