journal article·2020-10-19Open access

Deep Convolutional Neural Networks Object Detector for Real-Time Waste Identification

Daniel Octavian Melinte, Ana-Maria Travediu, Dan N. Dumitriu

Applied Sciences· Volume 10· Issue 20

Abstract

This paper presents an extensive research carried out for enhancing the performances of convolutional neural network (CNN) object detectors applied to municipal waste identification. In order to obtain an accurate and fast CNN architecture, several types of Single Shot Detectors (SSD) and Regional Proposal Networks (RPN) have been fine-tuned on the TrashNet database. The network with the best performances is executed on one autonomous robot system, which is able to collect detected waste from the ground based on the CNN feedback. For this type of application, a precise identification of municipal waste objects is very important. In order to develop a straightforward pipeline for waste detection, the paper focuses on boosting the performance of pre-trained CNN Object Detectors, in terms of precision, generalization, and detection speed, using different loss optimization methods, database augmentation, and asynchronous threading at inference time. The pipeline consists of data augmentation at the training time followed by CNN feature extraction and box predictor modules for localization and classification at different feature map sizes. The trained model is generated for inference afterwards. The experiments revealed better performances than all other Object Detectors trained on TrashNet or other garbage datasets with a precision of 97.63% accuracy for SSD and 95.76% accuracy for Faster R-CNN, respectively. In order to find the optimal higher and lower bounds of our learning rate where the network is actually learning, we trained our model for several epochs, updating the learning rate after each epoch, starting from 1 × 10−10 and decreasing it until reaching 1 × 10−1.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · COVID-19 diagnosis using AI · Brain Tumor Detection and Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Solid Mechanics of the Romanian Academy, 010141 Bucharest, Romania

Funding

Unitatea Executiva pentru Finantarea Invatamantului Superior, a Cercetarii, Dezvoltarii si Inovarii

References (40)

Show source-provided references
1. (2020, July 04). Waste Statistics, Eurostat. Available online: https://ec.europa.eu/eurostat/statistics-explained/index.php?title=Waste_statistics.
2. The European Parliament, and The Council of the European Union (2008). Directive 2008/98/EC of the European Parliament and of the Council on Waste and Repealing Certain Directives. Off. J. Eur. Union, 312, 30–47.
3. Control of an Autonomous Mobile Waste Collection Robot
4. Hossain, S., Debnath, B., Anika, A., Hossain, J.A., Biswas, S., and Shahnaz, C. (2019, January 17–20). Autonomous Trash Collector Based on Object Detection Using Deep Neural Network. Proceedings of the TENCON 2019—2019 IEEE Region 10 Conference (TENCON), Kochi, India.10.1109/TENCON.2019.8929270 ↗
5. Construction waste recycling robot for nails and screws: Computer vision technology and neural network approach10.1016/j.autcon.2018.11.009 ↗
6. Deep learning computer vision for sorting and size determination of municipal waste
7. Yang, M., and Thung, G. (2016). Classification of Trash for Recyclability Status, Stanford University.
8. Awe, O., Mengistu, R., and Sreedhar, V. (2017). Smart trash net: Waste localization and classification. arXiv, preprint.
9. Kennedy, T. (2018). OscarNet: Using Transfer Learning to Classify Disposable Waste, Stanford University.
10. Kulkarni, H.N., and Raman, N.K.S. (2018). Waste Object Detection and Classification, Stanford University.
11. Bircanoglu, C., Atay, M., Beser, F., Genc, O., and Kizrak, M.A. (2018, January 3–5). RecycleNet: Intelligent Waste Sorting Using Deep Neural Networks. Proceedings of the 2018 Innovations in Intelligent Systems and Applications (INISTA), Thessaloniki, Greece.10.1109/INISTA.2018.8466276 ↗
12. Costa, B.S., Bernardes, A.C., Pereira, J.V., Zampa, V.H., Pereira, V.A., Matos, G.F., Soares, E.A., Soares, C.L., and Silva, A.F. (2018, January 22–25). Artificial intelligence in automated sorting in trash recycling. Proceedings of the Anais do XV Encontro Nacional de Inteligência Artificial e Computacional, São Paulo, Brazil.10.5753/eniac.2018.4416 ↗
13. Intelligent Waste Classification System Using Deep Learning Convolutional Neural Network10.1016/j.promfg.2019.05.086 ↗
14. Sousa, J., Rebelo, A., and Cardoso, J.S. (2019, January 9–11). Automation of Waste Sorting with Deep Learning. Proceedings of the 2019 XV Workshop de Visão Computacional (WVC), Sao Paulo, Brazil.10.1109/WVC.2019.8876924 ↗
15. Xu, X., Qi, X., and Diao, X. (2020, February 23). Reach on Waste Classification and Identification by Transfer Learning and Lightweight Neural Network. Available online: https://www.preprints.org/manuscript/202002.0327/v1.
16. Lee, S.-H., Yeh, C.-H., Hou, T.-W., and Yang, C.-S. (2019, January 22–24). A Lightweight Neural Network Based on AlexNet-SSD Model for Garbage Detection. Proceedings of the 2019 3rd High Performance Computing and Cluster Technologies Conference on HPCCT 2019, Guangzhou, China.10.1145/3341069.3341087 ↗
17. Chu, Y., Huang, C., Xie, X., Tan, B., Kamal, S., and Xiong, X. (2018). Multilayer Hybrid Deep-Learning Method for Waste Classification and Recycling. Comput. Intell. Neurosci., 2018.10.1155/2018/5060857 ↗
18. Mazzeo, P.L., Argentieri, A., De Luca, F., Spagnolo, P., Distante, C., Leo, M., and Carcagni, P. (2019). Convolutional neural networks for recognition and segmentation of aluminum profiles. Multimodal Sens. Technol. Appl.10.1117/12.2525687 ↗
19. Yan, H., Wang, H., Vladareanu, L., Lin, M., Vlădăreanu, V., and Li, Y. (2019). Detection of Participation and Training Task Difficulty Applied to the Multi-Sensor Systems of Rehabilitation Robots. Sensors, 19.10.3390/s19214681 ↗
20. Research on Upper Limb Biomechanical System
21. Gal, I.-A., Bucur, D., and Vlădăreanu, L. (2018). DSmT Decision-Making Algorithms for Finding Grasping Configurations of Robot Dexterous Hands. Symmetry, 10.10.3390/sym10060198 ↗
22. Theory and application of extension hybrid force-position control in robotics
23. Vladareanu, L., Tont, G., Vladareanu, V., Smarandache, F., and Capitanu, L. (2012, January 18–22). The navigation mobile robot systems using Bayesian approach through the virtual projection method. Proceedings of the 2012 International Conference on Advanced Mechatronic Systems, Tokyo, Japan.
24. Thung, G. (2020, March 04). Trashnet. GitHub Repository. Available online: https://github.com/garythung/trashnet.
25. Bridle, J.S. (1990, January 26–29). Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters. Proceedings of the Advances in Neural Information Processing Systems, Denver, CO, USA.
26. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). Ssd: Single shot multibox detector. European Conference on Computer Vision, Springer.10.1007/978-3-319-46448-0_2 ↗
27. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.-C. (2018, January 18–23). MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
28. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., and Wojna, Z. (2016, January 27–30). Rethinking the Inception Architecture for Computer Vision. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.308 ↗
29. Ioffe, S., and Szegedy, C. (2015). Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv.
30. Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation Inc.
31. He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
32. The Open Images Dataset V410.1007/s11263-020-01316-z ↗
33. Smith, L.N. (2017, January 24–31). Cyclical Learning Rates for Training Neural Networks. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.10.1109/WACV.2017.58 ↗
34. Kingma, D.P., and Ba, J. (2014). Adam: A Method for Stochastic Optimization. arXiv.
35. Divide the gradient by a running average of its recent magnitude
36. Adaptive subgradient methods for online learning and stochastic optimization
37. Zeiler, M.D. (2012). Adadelta: An adaptive learning rate method. arXiv.
38. Dozat, T. (2016, January 2–4). Incorporating Nesterov Momentum into Adam. Proceedings of the ICLR 2016 Workshop, San Juan, Puerto Rico. Available online: https://openreview.net/pdf?id=OM0jvwB8jIp57ZJjtNEZ.
39. The Pascal Visual Object Classes (VOC) Challenge10.1007/s11263-009-0275-4 ↗
40. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). Microsoft COCO: Common Objects in Context. Lecture Notes in Computer Science, Springer Science and Business Media LLC.10.1007/978-3-319-10602-1_48 ↗