journal article·2021-11-16Open access

A Generative Adversarial Network Structure for Learning with Small Numerical Data Sets

Der-Chiang Li, Szu-Chou Chen, Yao-San Lin, Kuan-Cheng Huang

Applied Sciences· Volume 11· Issue 22

Abstract

In recent years, generative adversarial networks (GANs) have been proposed to generate simulated images, and some works of literature have applied GAN to the analysis of numerical data in many fields, such as the prediction of building energy consumption and the prediction and identification of liver cancer stages. However, these studies are based on sufficient data volume. In the current era of globalization, the demand for rapid decision-making is increasing, but the data available in a short period of time is scarce. As a result, machine learning may not provide precise results. Obtaining more information from a small number of samples has become an important issue. Therefore, this study aimed to modify the generative adversarial network structure for learning with small numerical datasets, starting with the Wasserstein GAN (WGAN) as the GAN architecture, and using mega-trend-diffusion (MTD) to limit the bound of virtual samples that the GAN generates. The model verification of our proposed structure was conducted with two datasets in the UC Irvine Machine Learning Repository, and the performance was evaluated using three criteria: accuracy, standard deviation, and p-value. The experiment result shows that, using this improved GAN architecture (WGAN_MTD), small sample data can also be used to generate virtual samples that are similar to real samples through GAN.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Generative Adversarial Networks and Image Synthesis · Image and Signal Denoising Methods · Model Reduction and Neural Networks

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Industrial and Information Management, National Cheng Kung University, No. 1, University Road, East Dist., Tainan City 70101, Taiwan

Institute of Information Management, National Cheng Kung University, No. 1, University Road, East Dist., Tainan City 70101, Taiwan

Singapore Centre for Chinese Language, Nanyang Technological University, No. 287, Ghim Moh Road, Singapore 279623, Singapore

References (23)

Show source-provided references
1. Bootstrapping to solve the limited data problem in production control: An application in batch process industries10.1057/palgrave.jors.2601966 ↗
2. Simulation metamodel development using uniform design and neural networks for automated material handling systems in semiconductor wafer fabrication10.1016/j.simpat.2007.05.006 ↗
3. Process modeling with neural networks using small experimental datasets10.1016/S0098-1354(99)00282-3 ↗
4. Learning Bayesian network parameters from small data sets: Application of Noisy-OR gates10.1016/S0888-613X(01)00039-1 ↗
5. A new approach to prediction of radiotherapy of bladder cancer cells in small dataset analysis10.1016/j.eswa.2010.12.035 ↗
6. Prediction of the period of psychotic episode in individual schizophrenics by simulation-data construction approach10.1007/s10916-009-9294-5 ↗
7. Rebuilding sample distributions for small dataset learning10.1016/j.dss.2017.10.013 ↗
8. Wasserstein GAN-Based Small-Sample Augmentation for New-Generation Artificial Intelligence: A Case Study of Cancer-Staging Data in Biology10.1016/j.eng.2018.11.018 ↗
9. Gonzalez-Abril, L., Angulo, C., Ortega, J.A., and Lopez-Guerra, J.L. (2021). Generative Adversarial Networks for Anonymized Healthcare of Lung Cancer Patients. Electronics, 10.10.3390/electronics10182220 ↗
10. MFC-GAN: Class-imbalanced dataset classification using multiple fake class generative adversarial network10.1016/j.neucom.2019.06.043 ↗
11. Imbalanced data learning by minority class augmentation using capsule adversarial networks10.1016/j.neucom.2020.01.119 ↗
12. Improved overlap-based undersampling for imbalanced dataset classification with application to epilepsy and parkinson’s disease10.1142/S0129065720500434 ↗
13. Generative adversarial nets
14. Efron, B., and Tibshirani, R.J. (1994). An Introduction to the Bootstrap, CRC Press.10.1201/9780429246593 ↗
15. Incorporating prior information in machine learning by creating virtual examples10.1109/5.726787 ↗
16. Using functional virtual population as assistance to learn scheduling knowledge in dynamic manufacturing environments10.1080/0020754031000149211 ↗
17. Principle of information diffusion10.1016/S0165-0114(96)00257-6 ↗
18. A diffusion-neural-network for learning from small samples10.1016/j.ijar.2003.06.001 ↗
19. The attribute-trend-similarity method to improve learning performance for small datasets10.1080/00207543.2016.1213447 ↗
20. Mirza, M., and Osindero, S. (2014). Conditional generative adversarial nets. arXiv.
21. Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein Generative Adversarial Networks. arXiv.
22. Convolutional neural networks: An overview and application in radiology10.1007/s13244-018-0639-9 ↗
23. Using mega-trend-diffusion and artificial samples in small data set learning for early flexible manufacturing system scheduling knowledge10.1016/j.cor.2005.05.019 ↗