journal article·2022-04-01Open access

Texture and Materials Image Classification Based on Wavelet Pooling Layer in CNN

Juan Manuel Fortuna-Cervantes, Marco Tulio Ramírez-Torres, Marcela Mejía-Carlos, José Salomé Murguía, José Martinez-Carranza, Carlos Soubervielle-Montalvo, César Arturo Guerra-García

Applied Sciences· Volume 12· Issue 7

Abstract

Convolutional Neural Networks (CNNs) have recently been proposed as a solution in texture and material classification in computer vision. However, inside CNNs, the internal layers of pooling often cause a loss of information and, therefore, is detrimental to learning the architecture. Moreover, when considering images with repetitive and essential patterns, the loss of this information affects the performance of subsequent stages, such as feature extraction and analysis. In this paper, to solve this problem, we propose a classification system with a new pooling method called Discrete Wavelet Transform Pooling (DWTP). This method is based on the image decomposition into sub-bands, in which the first level sub-band is considered as its output. The objective is to obtain approximation and detail information. As a result, this information can be concatenated in different combinations. In addition, wavelet pooling uses wavelets to reduce the size of the feature map. Combining these methods provides acceptable classification performance for three databases (CIFAR-10, DTD, and FMD). We argue that this helps eliminate overfitting and that the learning graphs reflect that the datasets show learning generalization. Therefore, our results indicate that our method based on wavelet analysis is feasible for texture and material classification. Moreover, in some cases, it outperforms traditional methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Image Retrieval and Classification Techniques · Advanced Image and Video Retrieval Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Instituto de Investigación en Comunicación Óptica, Universidad Autónoma de San Luis Potosí, Álvaro Obregón 64, San Luis Potosí 78000, Mexico

Coordinación Académica Región Altiplano Oeste, Universidad Autónoma de San Luis Potosí, Carretera Salinas-Santo Domingo 200 Salinas, San Luis Potosí 78600, Mexico

Facultad de Ciencias, Universidad Autónoma de San Luis Potosí, Av. Chapultepec 1570, Priv. del Pedregal, San Luis Potosí 78295, Mexico

Laboratorio Nacional CI3M, Facultad de Ciencias, Universidad Autónoma de San Luis Potosí, Av. Chapultepec 1570, Priv. del Pedregal, San Luis Potosí 78295, Mexico

Department of Computational Science, Instítuto Nacional de Astrofísica, Óptica y Electrónica (INAOE), Puebla 72840, Mexico

Centro de Investigación y Estudios de Posgrado, Facultad de Ingeniería—UASLP, Av. Dr. Manuel Nava 8, Zona Universitaria, San Luis Potosí 78290, Mexico

References (45)

Show source-provided references
1. Autonomous Drone Racing with an Opponent: A First Approach
2. Alcalá-Rmz, V., Maeda-Gutiérrez, V., Zanella-Calzada, L.A., Valladares-Salgado, A., Celaya-Padilla, J.M., and Galván-Tejada, C.E. (2020, January 12–17). Convolutional Neural Network for Classification of Diabetic Retinopathy Grade. Proceedings of the Mexican International Conference on Artificial Intelligence, Mexico City, Mexico.10.1007/978-3-030-60884-2_8 ↗
3. Tapia-Téllez, J.M., and Escalante, H.J. (2020, January 12–17). Data Augmentation with Transformers for Text Classification. Proceedings of the Mexican International Conference on Artificial Intelligence, Mexico City, Mexico.10.1007/978-3-030-60887-3_22 ↗
4. Deep learning10.1038/nature14539 ↗
5. Bengio, Y., Goodfellow, I., and Courville, A. (2017). Deep Learning, MIT Press.
6. Content-based image retrieval methods10.1134/S0361768809030049 ↗
7. Fujieda, S., Takayama, K., and Hachisuka, T. (2018). Wavelet convolutional neural networks. arXiv.
8. Using filter banks in convolutional neural networks for texture classification10.1016/j.patrec.2016.08.016 ↗
9. Williams, T., and Li, R. (May, January 30). Wavelet pooling for convolutional neural networks. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada.
10. Multifrequency channel decompositions of images and wavelet models10.1109/29.45554 ↗
11. Object Detection in Aerial Navigation using Wavelet Transform and Convolutional Neural Networks: A First Approach10.1134/S0361768820080113 ↗
12. Chaabane, C.B., Mellouli, D., Hamdani, T.M., Alimi, A.M., and Abraham, A. (2017, January 14–16). Wavelet convolutional neural networks for handwritten digits recognition. Proceedings of the International Conference on Hybrid Intelligent Systems, Delhi, India.
13. Vehicle Classification using a Real-Time Convolutional Structure based on DWT pooling layer and SE blocks10.1016/j.eswa.2021.115420 ↗
14. Ferrà, A., Aguilar, E., and Radeva, P. (2018, January 8–14). Multiple Wavelet Pooling for CNNs. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.10.1007/978-3-030-11018-5_55 ↗
15. Combining max-pooling and wavelet pooling strategies for semantic image segmentation10.1016/j.eswa.2021.115403 ↗
16. Li, Q., and Shen, L. (2021). 3D WaveUNet: 3D Wavelet Integrated Encoder-Decoder Network for Neuron Segmentation. arXiv.10.1093/bioinformatics/btab716 ↗
17. Multiple sclerosis lesion segmentation from brain MRI using U-Net based on wavelet pooling10.1007/s11548-021-02327-y ↗
18. Multi-level wavelet convolutional neural networks10.1109/ACCESS.2019.2921451 ↗
19. An ensemble of convolutional neural networks using wavelets for image classification10.4236/jsea.2018.112004 ↗
20. Piao, J., Chen, Y., and Shin, H. (2019). A new deep learning based multi-spectral image fusion method. Entropy, 21.10.3390/e21060570 ↗
21. Wavelet based edge feature enhancement for convolutional neural networks
22. Burrus, C.S. (1997). Introduction to Wavelets and Wavelet Transforms: A Primer, Pearson.
23. Walker, J.S. (2008). A Primer on Wavelets and Their Scientific Applications, CRC Press. [3rd ed.].10.1201/9781584887461 ↗
24. A theory for multiresolution signal decomposition: The wavelet representation10.1109/34.192463 ↗
25. Zur theorie der orthogonalen funktionensysteme10.1007/BF01456326 ↗
26. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
27. Aggarwal, C.C. (2018). Neural Networks and deep Learning, Springer Nature.10.1007/978-3-319-94463-0 ↗
28. Williams, T., and Li, R. (2016, January 18–20). Advanced image classification using wavelets and convolutional neural networks. Proceedings of the 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA), Anaheim, CA, USA.10.1109/ICMLA.2016.0046 ↗
29. Nielsen, M.A. (2015). Neural Networks and Deep Learning, Determination Press.
30. Lee, C.Y., Gallagher, P.W., and Tu, Z. (2016, January 9–11). Generalizing pooling functions in convolutional neural networks: Mixed, gated, and tree. Proceedings of the Artificial Intelligence and Statistics, Cadiz, Spain.
31. Handwritten digit recognition with a back-propagation network
32. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
33. Sparse feature learning for deep belief networks
34. Zeiler, M.D., Ranzato, M., Monga, R., Mao, M., Yang, K., Le, Q.V., Nguyen, P., Senior, A., Vanhoucke, V., and Dean, J. (2013, January 26–31). On rectified linear units for speech processing. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.10.1109/ICASSP.2013.6638312 ↗
35. Chollet, F. (2018). Deep Learning with Python, Manning Publications Co.
36. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
37. Brigato, L., and Iocchi, L. (2021, January 10–15). A close look at deep learning with small data. Proceedings of the 2020 25th International Conference on Pattern Recognition (ICPR), Milan, Italy.10.1109/ICPR48806.2021.9412492 ↗
38. Srivastava, N. (2013). Improving Neural Networks with Dropout. [Ph.D. Dissertation, University of Toronto].
39. Mikołajczyk, A., and Grochowski, M. (2018, January 9–12). Data augmentation for improving deep learning in image classification problem. Proceedings of the 2018 International Interdisciplinary PhD Workshop (IIPhDW), Swinoujscie, Poland.10.1109/IIPHDW.2018.8388338 ↗
40. Ioffe, S., and Szegedy, C. (2015, January 7–9). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France.
41. Learning representations by back-propagating errors10.1038/323533a0 ↗
42. Krizhevsky, A., and Hinton, G. (2022, March 07). Learning Multiple Layers of Features from Tiny Images. Available online: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.222.9220&rep=rep1&type=pdf.
43. Cimpoi, M., Maji, S., Kokkinos, I., Mohamed, S., and Vedaldi, A. (2014, January 23–28). Describing textures in the wild. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.461 ↗
44. Material perception: What can you see in a brief glance?10.1167/9.8.784 ↗
45. Lin, F., Hou, T., Jin, Q., and You, A. (2021). Improved YOLO Based Detection Algorithm for Floating Debris in Waterway. Entropy, 23.10.3390/e23091111 ↗