The Effect of Blue Noise on the Optimization Ability of Hopfield Neural Network
Source abstract
Abstract
Noise is ubiquitous in the real-world environment. At present, most scholars only include the stage of Gaussian white noise when applying noise in neural networks and regard white noise as a tool to optimize the network model, which is far from enough, because noise not only affects the optimization ability of the Hopfield neural network but can also better fit the needs of the actual use of the scene. Therefore, according to the problems in the existing research, a method is proposed to combine the neural network with colored noise according to the signal-to-noise ratio. Taking blue noise as an example, the anti-interference ability of the Hopfield neural network regarding colored noise is studied. The results show that for the Hopfield neural network driven by blue noise, by adjusting the neural network step size, excitation function and signal-to-noise ratio, it not only provides ideas for adding colored noise to the neural network but also enables the neural network model to have better optimization-seeking ability. The research results have some reference significance for improving the practical application of neural networks in noisy environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Neural Networks and Applications · Advanced Algorithms and Applications · Advanced Decision-Making Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer and Information Engineering, Harbin University of Commerce, Harbin 150028, China
Funding
Nature Science Foundation of Heilongjiang Province
References (50)
Show source-provided references
1. Ran, X., Zhou, X., Lei, M., Tepsan, W., and Deng, W. (2021). A Novel K-Means Clustering Algorithm with a Noise Algorithm for Capturing Urban Hotspots. Appl. Sci., 11.10.3390/app112311202 ↗
2. Dealing with noise problem in machine learning data-sets: A systematic review10.1016/j.procs.2019.11.146 ↗
3. Fung, C.H., Wong, M.S., and Chan, P.W. (2019). Spatio-Temporal Data Fusion for Satellite Images Using Hopfield Neural Network. Remote Sens., 11.10.3390/rs11182077 ↗
4. A Study on the 3D Hopfield Neural Network Model via Nonlocal Atangana–Baleanu Operators10.1155/2022/6784886 ↗
5. Xu, X., and Chen, S. (2021). Single Neuronal Dynamical System in Self-Feedbacked Hopfield Networks and Its Application in Image Encryption. Entropy, 23.10.3390/e23040456 ↗
6. Citko, W., and Sienko, W. (2022). Inpainted Image Reconstruction Using an Extended Hopfield Neural Network Based Machine Learning System. Sensors, 22.10.3390/s22030813 ↗
7. Dynamical System in Chaotic Neurons with Time Delay Self-Feedback and Its Application in Color Image Encryption10.1155/2022/2832104 ↗
8. Xiao, Y., Zhang, Y., Dai, X., and Yan, D. (2022). Clustering Based on Continuous Hopfield Network. Mathematics, 10.10.3390/math10060944 ↗
9. Hillar, C., Chan, T., Taubman, R., and Rolnick, D. (2021). Hidden Hypergraphs, Error-Correcting Codes, and Critical Learning in Hopfield Networks. Entropy, 23.10.3390/e23111494 ↗
10. Mohd Jamaludin, S.Z., Mohd Kasihmuddin, M.S., Md Ismail, A.I., Mansor, M.A., and Md Basir, M.F. (2021). Energy Based Logic Mining Analysis with Hopfield Neural Network for Recruitment Evaluation. Entropy, 23.10.3390/e23010040 ↗
11. An optimization routing protocol for FANETs10.1186/s13638-019-1442-0 ↗
12. A new hybrid routing protocol using a modified K-means clustering algorithm and continuous hopfield network for VANET10.1109/ACCESS.2021.3068074 ↗
13. Dynamic positioning colored noise influence function—A first order ar model as an example
14. Aviles-Espinosa, R., Dore, H., and Rendon-Morales, E. (2023). An Experimental Method for Bio-Signal Denoising Using Unconventional Sensors. Sensors, 23.10.3390/s23073527 ↗
15. Peng, J., Xu, Y., Luo, L., Liu, H., Lu, K., and Liu, J. (2023). Regularized Denoising Masked Visual Pretraining for Robust Embodied PointGoal Navigation. Sensors, 23.10.3390/s23073553 ↗
16. Optimal tracking control of networked systems subject to model uncertainty and additive colored Gaussian noise
17. Stochastic properties of thermoacoustic oscillations in an annular gas turbine combustion chamber driven by colored noise10.1016/j.jsv.2020.115423 ↗
18. Critical active dynamics is captured by a colored-noise driven field theory10.1038/s42005-022-00830-5 ↗
19. Adaptive grayscale compressive spectral imaging using optimal blue noise coding patterns10.1016/j.optlastec.2019.03.038 ↗
20. The importance of noise colour in simulations of evolutionary systems
21. Wavelet Analysis of Red Noise and Its Application in Climate Diagnosis
22. Hatayama, A., Matsubara, A., Nakashima, S., and Nishifuji, S. (2021, January 12–15). Effect of Pink Noise on EEG and Memory Performance in Memory Task. Proceedings of the 2021 IEEE 10th Global Conference on Consumer Electronics (GCCE), Kyoto, Japan.10.1109/GCCE53005.2021.9622081 ↗
23. Phase locking of ultra-low power consumption stochastic magnetic bits induced by colored noise10.1016/j.chaos.2021.111262 ↗
24. Noisy Activation Functions
25. Fault Diagnosis Method and Application Based on Multi-scale Neural Network and Data Enhancement for Strong Noise
26. Vision-based concrete crack detection using a hybrid framework considering noise effect
27. Robust extended dissipativity analysis for Markovian jump discrete-time delayed stochastic singular neural networks10.1007/s00521-019-04497-y ↗
28. Further Results on Dissipativity Criterion for Markovian Jump Discrete-Time Neural Networks with Two Delay Components Via Discrete Wirtinger Inequality Approach10.1007/s11063-016-9559-1 ↗
29. State estimation for discrete-time neural networks with two additive time-varying delay components based on passivity theory
30. Stability analysis of fraction-order Hopfield neuron network and noise-induced coherence resonance10.1155/2020/3520972 ↗
31. A Method for Colored Noise Generation
32. Full-phase filtered white noise generates colored noise and its power spectrum estimation
33. A review of detection signal-to-noise ratio calculation methods and principles
34. Classification with class noises through probabilistic sampling10.1016/j.inffus.2017.08.007 ↗
35. Empirical case studies in attribute noise detection10.1109/TSMCC.2009.2013815 ↗
36. Wavelet chaotic neural network with white noise and its application
37. Boykov, I., Roudnev, V., and Boykova, A. (2022). Approximate Methods for Solving Problems of Mathematical Physics on Neural Hopfield Networks. Mathematics, 10.10.3390/math10132207 ↗
38. Rubio-Manzano, C., Segura-Navarrete, A., Martinez-Araneda, C., and Vidal-Castro, C. (2021). Explainable Hopfield Neural Networks Using an Automatic Video-Generation System. Appl. Sci., 11.10.3390/app11135771 ↗
39. A segmental annealing strategy for radial basis chaotic neural networks and applications
40. Research on chaotic neural networks with perturbation
41. Huang, D.S., Zhao, Z., Bevilacqua, V., and Figueroa, J.C. (2010). Advanced Intelligent Computing Theories and Applications ICIC 2010, Springer. Lecture Notes in Computer Science.10.1007/978-3-642-14922-1 ↗
42. A new column-row method for traveling salesman problem: The dhouib-matrix-TSP110.14445/23497157/IJRES-V8I1P102 ↗
43. Improving the state-of-the-art in the traveling salesman problem: An anytime automatic algorithm selection10.1016/j.eswa.2021.115948 ↗
44. Enhanced List-Based Simulated Annealing Algorithm for Large-Scale Traveling Salesman Problem10.1109/ACCESS.2019.2945570 ↗
45. Xu, Y., Liu, X., He, R., Zhu, Y., Zuo, Y., and He, L. (2023). Active Debris Removal Mission Planning Method Based on Machine Learning. Mathematics, 11.10.3390/math11061419 ↗
46. A chaotic Hopfield network and its application in optimization computing
47. Chaotic neural networks with Gaussian perturbations and applications
48. Applying evolutionay programming to selected traveling salesman problems10.1080/01969729308961697 ↗
49. Chaotic simulated annealing by a neural network model with transient chaos10.1016/0893-6080(95)00033-V ↗
50. A novel hysteretic chaotic neural network and its applications10.1016/j.neucom.2007.02.002 ↗