Data Augmentation and Random Multi-Model Deep Learning for Data Classification
Source abstract
Abstract
In the machine learning (ML) paradigm, data augmentation serves as a regularization approach for creating ML models. The increase in the diversification of training samples increases the generalization capabilities, which enhances the prediction performance of classifiers when tested on unseen examples. Deep learning (DL) models have a lot of parameters, and they frequently overfit. Effectively, to avoid overfitting, data plays a major role to augment the latest improvements in DL. Nevertheless, reliable data collection is a major limiting factor. Frequently, this problem is undertaken by combining augmentation of data, transfer learning, dropout, and methods of normalization in batches. In this paper, we introduce the application of data augmentation in the field of image classification using Random Multi-model Deep Learning (RMDL) which uses the association approaches of multiDL to yield random models for classification. We present a methodology for using Generative Adversarial Networks (GANs) to generate images for data augmenting. Through experiments, we discover that samples generated by GANs when fed into RMDL improve both accuracy and model efficiency. Experimenting across both MNIST and CIAFAR-10 datasets show that, error rate with proposed approach has been decreased with different random models.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Generative Adversarial Networks and Image Synthesis · Machine Learning and Data Classification · Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (45)
Show source-provided references
1. J. Chung, C. Gulcehre, K. Cho and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” arXiv preprint arXiv:1412.3555, 2014.
2. Rmdl: Random multimodel deep learning for classification
3. Understanding inverse document frequency: On theoretical arguments for IDF10.1108/00220410410560582 ↗
4. Regularization for unsupervised deep neural nets
5. Y. Kubo, G. Tucker and S. Wiesler, “Compacting neural network classifiers via dropout training,” arXiv preprint arXiv:1611.06148, 2016.
6. Gal · Proc. of the Advances in Neural Information Processing Systems · 2016 · 1019
7. Dropout: A simple way to prevent neural networks from overfitting
8. Batch normalization: Accelerating deep network training by reducing internal covariate shift
9. S. Xiang and H. Li, “On the effects of batch and weight normalization in generative adversarial networks,” arXiv preprint arXiv:1704.03971, 2017.
10. Best practices for convolutional neural networks applied to visual document analysis
11. Smart augmentation learning an optimal data augmentation strategy10.1109/ACCESS.2017.2696121 ↗
12. The effectiveness of data augmentation in image classification using deep learning
13. Understanding data augmentation for classification: When to warp?
14. A survey on Image Data Augmentation for Deep Learning10.1186/s40537-019-0197-0 ↗
15. Twenty years of document image analysis in pami10.1109/34.824820 ↗
16. Deep, big, simple neural nets for handwritten digit recognition10.1162/NECO_a_00052 ↗
17. Training invariant support vector machines using selective sampling
18. L. Perez and J. Wang, “The effectiveness of data augmentation in image classification using deep learning,” arXiv preprint arXiv:1712.04621, 2017.
19. E. D. Cubuk, B. Zoph, D. Mane, V. Vasudevan and Q. V. Le, “Autoaugment: Learning augmentation policies from data,” arXiv preprint arXiv:1805.09501, 2018.10.1109/CVPR.2019.00020 ↗
20. Deligan: Generative adversarial networks for diverse and limited data
21. M. Marchesi, “Megapixel size image creation using generative adversarial networks,” arXiv preprint arXiv:1706.00082, 2017.
22. Improved techniques for training GANs
23. The mnist database of handwritten digit images for machine learning research [best of the web]10.1109/MSP.2012.2211477 ↗
24. A. Krizhevsky, V. Nair and G. Hinton, “The CIFAR-10 dataset,” 2014. [Online]. Available: http://www.cs.toronto.edu/kriz/cifar.Html.
25. Recurrent topic-transition gan for visual paragraph generation
26. Unsupervised representation learning with deep convolutional neural network for remote sensing images
27. Robust training under linguistic adversity
28. S. Kobayashi, “Contextual augmentation: Data augmentation by words with paradigmatic relations,” arXiv preprint arXiv:1805.06201, 2018.10.18653/v1/N18-2072 ↗
29. Distributed representations of words and phrases and their compositionality
30. Identifying tweets with fake news
31. Automatic classification of complaint reports about city park10.52731/iee.v1.i4.35 ↗
32. Simplicity of kmeans versus deepness of deep learning: A case of unsupervised feature learning with limited data
33. Named entity recognition with word embeddings and wikipedia categories for a low-resource language10.1145/3015467 ↗
34. Glove: Global vectors for word representation
35. Software framework for topic modelling with large corpora
36. Rectified linear units improve restricted boltzmann machines
37. Learning long-term dependencies with gradient descent is difficult10.1109/72.279181 ↗
38. Adaptive subgradient methods for online learning and stochastic optimization
39. M. D. Zeiler, “Adadelta: An adaptive learning rate method,” arXiv preprint arXiv:1212.5701, 2012.
40. Kowsari · Web of Science Dataset · 2018
41. F. Chollet, “Keras: Deep learning library for theano and tensorflow,” vol. 7, no. 8, pp. T1, 2015, URL: https://keras.io/k.
42. Y. Tang, “Deep learning using linear support vector machines,” arXiv preprint arXiv:1306.0239, 2013.
43. Pcanet: A simple deep learning baseline for image classification?10.1109/TIP.2015.2475625 ↗
44. Zhou · Proc. of the Twenty-Sixth Int. Joint Conf. on Artificial Intelligence · 2017 · 355310.24963/ijcai.2017/497 ↗
45. Hierarchical attention networks for document classification