journal article·2023Open access

An Optimization Approach for Convolutional Neural Network Using Non-Dominated Sorted Genetic Algorithm-II

Afia Zafar, Muhammad Aamir, Nazri Mohd Nawi, Ali Arshad, Saman Riaz, Abdulrahman Alruban, Ashit Kumar Dutta, Badr Almutairi, Sultan Almotairi

Computers, Materials & Continua· Volume 74· Issue 3

Abstract

In computer vision, convolutional neural networks have a wide range of uses. Images represent most of today’s data, so it’s important to know how to handle these large amounts of data efficiently. Convolutional neural networks have been shown to solve image processing problems effectively. However, when designing the network structure for a particular problem, you need to adjust the hyperparameters for higher accuracy. This technique is time consuming and requires a lot of work and domain knowledge. Designing a convolutional neural network architecture is a classic NP-hard optimization challenge. On the other hand, different datasets require different combinations of models or hyperparameters, which can be time consuming and inconvenient. Various approaches have been proposed to overcome this problem, such as grid search limited to low-dimensional space and queuing by random selection. To address this issue, we propose an evolutionary algorithm-based approach that dynamically enhances the structure of Convolution Neural Networks (CNNs) using optimized hyperparameters. This study proposes a method using Non-dominated sorted genetic algorithms (NSGA) to improve the hyperparameters of the CNN model. In addition, different types and parameter ranges of existing genetic algorithms are used. A comparative study was conducted with various state-of-the-art methodologies and algorithms. Experiments have shown that our proposed approach is superior to previous methods in terms of classification accuracy, and the results are published in modern computing literature.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Neural Networks and Applications · Metaheuristic Optimization Algorithms Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (38)

Show source-provided references
1. Automatic prior selection for meta Bayesian optimization with a case study on tuning deep neural network optimizers
2. Learning to resize images for computer vision tasks
3. Recent advances in convolutional neural network acceleration10.1016/j.neucom.2018.09.038 ↗
4. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
5. Designing neural networks through neuroevolution10.1038/s42256-018-0006-z ↗
6. Probabilistic sequential multi-objective optimization of convolutional neural networks
7. B. Li, “A more effective random search for machine learning hyperparameters optimization,” Master Thesis, University of Tennessee, Knoxville, vol. 1, December, 2020.
8. Bayesian optimization of comprehensive two-dimensional liquid chromatography separations10.1016/j.chroma.2021.462628 ↗
9. Conservative q-learning for offline reinforcement learning,”
10. Recent advances in convolutional neural networks10.1016/j.patcog.2017.10.013 ↗
11. HOG-ShipCLSNet: A novel deep learning network with hog feature fusion for SAR ship classification
12. A multi-objective optimisation approach for activity excitation of waste glass mortar10.1016/j.jmrt.2022.01.066 ↗
13. A framework for large-scale analysis of video\“ in the wild\” to assist digital forensic examination10.1109/MSEC.2018.2875851 ↗
14. Prediction of thermo-mechanical properties of rubber-modified recycled aggregate concrete10.1016/j.conbuildmat.2021.125970 ↗
15. Muiltiobjective optimization using nondominated sorting in genetic algorithms10.1162/evco.1994.2.3.221 ↗
16. Classification of reservoir recovery factor for oil and gas reservoirs: A multi-objective feature selection approach10.3390/jmse9080888 ↗
17. Pareto multi-objective optimization of tandem cold rolling settings for reductions and inter stand tensions using NSGA-II
18. Cost-efficient approaches for fulfillment of functional coverage during verification of digital designs
19. A holistic review on artificial intelligence techniques for well placement optimization problem10.1016/j.advengsoft.2019.102767 ↗
20. Fast calibration of fault injection equipment with hyperparameter optimization techniques
21. Novel best path selection approach based on hybrid improved A* algorithm and reinforcement learning10.1007/s10489-021-02303-8 ↗
22. Automatic tuning of hyperparameters using Bayesian optimization10.1007/s12530-020-09345-2 ↗
23. Shortcut learning in deep neural networks
24. Extended reality (XR) remote research: A survey of drawbacks and opportunities
25. Efficient hyperparameter optimization in deep learning using a variable length genetic algorithm
26. Neural architecture search for inversion
27. Location-and person-independent activity recognition with WiFi, deep neural networks, and reinforcement learning10.1145/3424739 ↗
28. Application of Bayesian optimization and regression analysis to ferromagnetic materials development
29. Probost · Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery · May, 2019 · 77 · 1
30. Genetic algorithm-optimized multi-channel convolutional neural network for stock market prediction10.1007/s00521-019-04236-3 ↗
31. Deep neural network hyper-parameter tuning through twofold genetic approach10.1007/s00500-021-05770-w ↗
32. Speeding up the hyperparameter optimization of deep convolutional neural networks10.1142/S1469026818500086 ↗
33. Application of Bayesian optimization for pharmaceutical product development10.1007/s12247-019-09382-8 ↗
34. Comparative analysis of image classification algorithms based on traditional machine learning and deep learning10.1016/j.patrec.2020.07.042 ↗
35. E. Hulderson, “Adversarial example resistant hyperparameters and deep learning networks,” (Doctoral Dissertation, University of Washington), vol. 1, pp. 1–95, ProQuest Dissertations Publishing, 2021.
36. Clustering units in neural networks: Upstream vs downstream information
37. DiNNO: Distributed neural network optimization for multi-robot collaborative learning10.1109/LRA.2022.3142402 ↗
38. Weight initialization techniques for deep learning algorithms in remote sensing: Recent trends and future perspectives10.1007/978-981-16-5559-3_39 ↗