journal article·2022Open access

Swarm-Based Extreme Learning Machine Models for Global Optimization

Mustafa Abdul Salam, Ahmad Taher Azar, Rana Hussien

Computers, Materials & Continua· Volume 70· Issue 3

Abstract

Extreme Learning Machine (ELM) is popular in batch learning, sequential learning, and progressive learning, due to its speed, easy integration, and generalization ability. While, Traditional ELM cannot train massive data rapidly and efficiently due to its memory residence, high time and space complexity. In ELM, the hidden layer typically necessitates a huge number of nodes. Furthermore, there is no certainty that the arrangement of weights and biases within the hidden layer is optimal. To solve this problem, the traditional ELM has been hybridized with swarm intelligence optimization techniques. This paper displays five proposed hybrid Algorithms “Salp Swarm Algorithm (SSA-ELM), Grasshopper Algorithm (GOA-ELM), Grey Wolf Algorithm (GWO-ELM), Whale optimization Algorithm (WOA-ELM) and Moth Flame Optimization (MFO-ELM)”. These five optimizers are hybridized with standard ELM methodology for resolving the tumor type classification using gene expression data. The proposed models applied to the predication of electricity loading data, that describes the energy use of a single residence over a four-year period. In the hidden layer, Swarm algorithms are used to pick a smaller number of nodes to speed up the execution of ELM. The best weights and preferences were calculated by these algorithms for the hidden layer. Experimental results demonstrated that the proposed MFO-ELM achieved 98.13% accuracy and this is the highest model in accuracy in tumor type classification gene expression data. While in predication, the proposed GOA-ELM achieved 0.397which is least RMSE compared to the other models.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Machine Learning and ELM · Metaheuristic Optimization Algorithms Research · Neural Networks and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (35)

Show source-provided references
1. Op-elm: Optimally pruned extreme learning machine10.1109/TNN.2009.2036259 ↗
2. Extreme learning machine: Theory and applications10.1016/j.neucom.2005.12.126 ↗
3. Improved extreme learning machine for function approximation by encoding a priori information10.1016/j.neucom.2006.02.013 ↗
4. Extreme learning machine: A new learning scheme of feedforward neural networks
5. Empirical analysis: Stock market prediction via extreme learning machine10.1007/s00521-014-1550-z ↗
6. Evolutionary extreme learning machine, pattern recognition10.1016/j.patcog.2005.03.028 ↗
7. On improving the conditioning of extreme learning machine: A linear case
8. A study on effectiveness of extreme learning machine10.1016/j.neucom.2010.11.030 ↗
9. Salp swarm algorithm: A bio-inspired optimizer for engineering design problems10.1016/j.advengsoft.2017.07.002 ↗
10. An improved grasshopper optimization algorithm with application to financial stress prediction10.1016/j.apm.2018.07.044 ↗
11. Grey wolf algorithm-based clustering technique10.1515/jisys-2014-0137 ↗
12. Moth–flame optimization algorithm: Variants and applications10.1007/s00521-019-04570-6 ↗
13. The whale optimization algorithm10.1016/j.advengsoft.2016.01.008 ↗
14. Optimized ELM based on whale optimization algorithm for gearbox diagnosis
15. Extreme learning machine, theory and applications10.1016/j.neucom.2005.12.126 ↗
16. An improved evolutionary extreme learning machine based on particle swarm optimization10.1016/j.neucom.2011.12.062 ↗
17. Evolutionary extreme learning machine ensembles with size control10.1016/j.neucom.2011.12.046 ↗
18. Genetic ensemble of extreme learning machine10.1016/j.neucom.2013.09.042 ↗
19. Performance enhancement of extreme learning machine for multi-category sparse data classification problems10.1016/j.engappai.2010.06.009 ↗
20. Extreme learning machine based genetic algorithm and its application in power system economic dispatch10.1016/j.neucom.2011.12.054 ↗
21. Fpa-elm model for stock market prediction
22. A hybrid dragonfly algorithm with extreme learning machine for prediction
23. Optimizing connection weights in neural networks using the whale optimization algorithm10.1007/s00500-016-2442-1 ↗
24. An improved cuckoo search based extreme learning machine for medical data classification10.1016/j.swevo.2015.05.003 ↗
25. Multiple kernel extreme learning machine10.1016/j.neucom.2013.09.072 ↗
26. Optimization method based extreme learning machine for classification10.1016/j.neucom.2010.02.019 ↗
27. Weighted extreme learning machine for imbalance learning10.1016/j.neucom.2012.08.010 ↗
28. Development of spectroscopic sensor system for an IoT application of adulteration identification on milk using machine learning10.1109/ACCESS.2021.3070558 ↗
29. Extreme learning machine: Algorithm, theory and applications10.1007/s10462-013-9405-z ↗
31. Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm10.1016/j.knosys.2015.07.006 ↗
32. Ultra-short-term wind power prediction by salp swarm algorithm-based optimizing extreme learning machine10.1109/ACCESS.2020.2978098 ↗
33. Salp swarm algorithm: Theory, literature review, and application in extreme learning machines
34. K. Bache and M. “Lichman, “Uci machine learning repository,” 2013. [Online]. Available: https://archive.ics.uci.edu/ml/datasets/gene+expression+cancer+RNA-Seq.
35. K. Bache and M. Lichman, “Uci machine learning repository,” 2013. [Online]. Available: https://archive.ics.uci.edu/ml/datasets/ElectricityLoadDiagrams20112014.