journal article·2022-11-07Open access

Research on Generalized Hybrid Probability Convolutional Neural Network

Wenyi Zhou, Hongguang Fan, Jihong Zhu, Hui Wen, Ying Xie

Applied Sciences· Volume 12· Issue 21

Abstract

This paper first studies the generalization ability of the convolutional layer as a feature mapper (CFM) for extracting image features and the classification ability of the multilayer perception (MLP) in a CNN. Then, a novel generalized hybrid probability convolutional neural network (GHP-CNN) is proposed to solve abstract feature classification with an unknown distribution form. To measure the generalization ability of the CFM, a new index is defined and the positive correlation between it and the CFM is researched. Generally, a fully trained CFM can extract features that are beneficial to classification, regardless of whether the data participate in training the CFM. In the CNN, the fully connected layer in the MLP is not always optimal, and the extracted abstract feature has an unknown distribution. Thus, an improved classifier called the structure-optimized probabilistic neural network (SOPNN) is used for abstract feature classification in the GHP-CNN. In the SOPNN, the separability information is not lost in the normalization process, and the final classification surface is close to the optimal classification surface under the Bayesian criterion. The proposed GHP-CNN utilizes the generalization ability of the CFM and the classification ability of the SOPNN. Experiments show that the proposed network has better classification ability than the existing hybrid neural networks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Advanced Image and Video Retrieval Techniques · Face and Expression Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Physics and Electronic Information, Gannan Normal University, Ganzhou 341000, China

College of Computer, Chengdu University, Chengdu 610106, China

New Engineering Industry College, Putian University, Putian 351100, China

Engineering Research Center of Big Data Application in Private Health Medicine, Fujian Province University, Putian 351100, China

Funding

PHD Research Foundation of Gannan Normal University · National Natural Science Foundation of China · Open Foundation of Engineering Research Center of Big Data Application in Private Health Medicine, Fujian Province University · Fujian Provincial Natural Science Foundation Projects

References (30)

Show source-provided references
1. Face description with local binary patterns: Application to face recognition10.1109/TPAMI.2006.244 ↗
2. LBP-based edge-texture features for object recognition10.1109/TIP.2014.2310123 ↗
3. Speeded-up robust features (SURF)10.1016/j.cviu.2007.09.014 ↗
4. Li, J., and Zhang, Y. (2013, January 23–28). Learning surf cascade for fast and accurate object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.10.1109/CVPR.2013.445 ↗
5. SAR-SIFT: A SIFT-like algorithm for SAR images10.1109/TGRS.2014.2323552 ↗
6. SIFT meets CNN: A decade survey of instance retrieval10.1109/TPAMI.2017.2709749 ↗
7. A deep multi-modal CNN for multi-instance multi-label image classification10.1109/TIP.2018.2864920 ↗
8. Investigating nuisances in DCNN-based face recognition10.1109/TIP.2018.2861359 ↗
9. Multi-task convolutional neural network for pose-invariant face recognition10.1109/TIP.2017.2765830 ↗
10. Basu, T., Menzer, O., Ward, J., and SenGupta, I. (2022). A Novel Implementation of Siamese Type Neural Networks in Predicting Rare Fluctuations in Financial Time Series. Risks, 10.10.3390/risks10020039 ↗
11. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
12. Rama-Maneiro, E., Vidal, J.C., and Lama, M. (2021). Embedding Graph Convolutional Networks in Recurrent Neural Networks for Predictive Monitoring. arXiv.
13. Nassar, M., Wang, X., and Tumer, E. (2020). Fully Convolutional Graph Neural Networks using Bipartite Graph Convolutions. ICLR.
14. Improving graph convolutional networks based on relation-aware attention for end-to-end relation extraction10.1109/ACCESS.2020.2980859 ↗
15. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems, MIT Press.
16. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
17. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
18. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
19. A novel hybrid CNN–SVM classifier for recognizing handwritten digits10.1016/j.patcog.2011.09.021 ↗
20. A hybrid deep learning CNN–ELM for age and gender classification10.1016/j.neucom.2017.08.062 ↗
21. Fu, M.y., Liu, F.y., Yang, Y., and Wang, M.l. (2014, January 28–30). Background pixels mutation detection and Hu invariant moments based traffic signs detection on autonomous vehicles. Proceedings of the 33rd Chinese Control Conference, Nanjing, China.10.1109/ChiCC.2014.6896705 ↗
22. A survey on transfer learning10.1109/TKDE.2009.191 ↗
23. Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., and Wortman, J. (2008). Learning bounds for domain adaptation. Advances in Neural Information Processing Systems, MIT Press.
24. CRF learning with CNN features for image segmentation10.1016/j.patcog.2015.04.019 ↗
25. Hybrid CNN and dictionary-based models for scene recognition and domain adaptation10.1109/TCSVT.2015.2511543 ↗
26. Nguyen, D.T., Pham, T.D., Baek, N.R., and Park, K.R. (2018). Combining deep and handcrafted image features for presentation attack detection in face recognition systems using visible-light camera sensors. Sensors, 18.10.3390/s18030699 ↗
27. Guo, Z., Chen, Q., Wu, G., Xu, Y., Shibasaki, R., and Shao, X. (2017). Village building identification based on ensemble convolutional neural networks. Sensors, 17.10.3390/s17112487 ↗
28. Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images. [Master’s Thesis, University of Toronto].
29. Range space super spherical cap discriminant analysis10.1016/j.neucom.2017.03.031 ↗
30. An incremental learning algorithm for the hybrid RBF-BP network classifier10.1186/s13634-016-0357-8 ↗