journal article·2022-07-13Open access

GAN-Based Approaches for Generating Structured Data in the Medical Domain

Masoud Abedi, Lars Hempel, Sina Sadeghi, Toralf Kirsten

Applied Sciences· Volume 12· Issue 14

Abstract

Modern machine and deep learning methods require large datasets to achieve reliable and robust results. This requirement is often difficult to meet in the medical field, due to data sharing limitations imposed by privacy regulations or the presence of a small number of patients (e.g., rare diseases). To address this data scarcity and to improve the situation, novel generative models such as Generative Adversarial Networks (GANs) have been widely used to generate synthetic data that mimic real data by representing features that reflect health-related information without reference to real patients. In this paper, we consider several GAN models to generate synthetic data used for training binary (malignant/benign) classifiers, and compare their performances in terms of classification accuracy with cases where only real data are considered. We aim to investigate how synthetic data can improve classification accuracy, especially when a small amount of data is available. To this end, we have developed and implemented an evaluation framework where binary classifiers are trained on extended datasets containing both real and synthetic data. The results show improved accuracy for classifiers trained with generated data from more advanced GAN models, even when limited amounts of original data are available.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Generative Adversarial Networks and Image Synthesis · AI in cancer detection · Machine Learning in Healthcare

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department for Medical Data Science, Leipzig University Medical Center, 04107 Leipzig, Germany

Institute for Medical Informatics, Statistics and Epidemiology, Leipzig University, 04107 Leipzig, Germany

Faculty Applied Computer and Bio Sciences, Mittweida University of Applied Sciences, 09648 Mittweida, Germany

Funding

German Ministry for Research and Education (BMBF) · German Ministry of Health · Leipzig University Medical Center · Mittweida University of Applied Sciences

References (68)

Show source-provided references
1. Dahmen, J., and Cook, D. (2019). SynSys: A Synthetic Data Generation System for Healthcare Applications. Sensors, 19.10.3390/s19051181 ↗
2. Generating high-fidelity synthetic patient data for assessing machine learning healthcare software10.1038/s41746-020-00353-9 ↗
3. Synthetic data in machine learning for medicine and healthcare10.1038/s41551-021-00751-8 ↗
4. Synthetic data generation for tabular health records: A systematic review10.1016/j.neucom.2022.04.053 ↗
5. Voigt, P., and von dem Bussche, A. (2017). The EU General Data Protection Regulation (GDPR), Springer International Publishing.10.1007/978-3-319-57959-7 ↗
6. German Medical Informatics Initiative: Unlocking Data for Research and Health Care10.3414/ME18-13-0001 ↗
7. Using Publicly Available Data to Understand the Opioid Overdose Epidemic: Geospatial Distribution of Discarded Needles in Boston, Massachusetts10.2105/AJPH.2018.304583 ↗
8. The Systematic Review Data Repository (SRDR): Descriptive characteristics of publicly available data and opportunities for research10.1186/s13643-019-1250-y ↗
9. Factors associated with COVID-19 infections and mortality in Africa: A cross-sectional study using publicly available data10.1136/bmjopen-2020-042750 ↗
10. A global review of publicly available datasets for ophthalmological imaging: Barriers to access, usability, and generalisability10.1016/S2589-7500(20)30240-5 ↗
11. European Commission and Directorate-General for Research and Innovation (2017). Rare Diseases: A Major Unmet Medical Need, Publications Office.
12. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press. Google-Books-ID: omivDQAAQBAJ.
13. Generative Adversarial Networks: An Overview10.1109/MSP.2017.2765202 ↗
14. Bourou, S., El Saer, A., Velivassaki, T.H., Voulkidis, A., and Zahariadis, T. (2021). A Review of Tabular Data Synthesis Using GANs on an IDS Dataset. Information, 12.10.3390/info12090375 ↗
15. Borisov, V., Leemann, T., Seßler, K., Haug, J., Pawelczyk, M., and Kasneci, G. (2021). Deep Neural Networks and Tabular Data: A Survey. arXiv.
16. Patki, N., Wedge, R., and Veeramachaneni, K. (2016, January 17–19). The Synthetic Data Vault. Proceedings of the 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Montreal, QC, Canada.10.1109/DSAA.2016.49 ↗
17. Synthea: An approach, method, and software mechanism for generating synthetic patients and the synthetic electronic health care record10.1093/jamia/ocx079 ↗
18. Synthia: Multidimensional synthetic data generation in Python10.21105/joss.02863 ↗
19. synthpop: Bespoke Creation of Synthetic Data in R10.18637/jss.v074.i11 ↗
20. Simulation of Synthetic Complex Data: The R Package simPop10.18637/jss.v079.i10 ↗
21. Kingma, D.P., and Welling, M. (2013). Auto-Encoding Variational Bayes. arXiv.
22. An Introduction to Variational Autoencoders10.1561/2200000056 ↗
23. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Networks. arXiv.
24. Elbattah, M., Loughnane, C., Guérin, J.L., Carette, R., Cilia, F., and Dequen, G. (2021). Variational Autoencoder for Image-Based Augmentation of Eye-Tracking Data. J. Imaging, 7.10.3390/jimaging7050083 ↗
25. Variational Autoencoder Modular Bayesian Networks for Simulation of Heterogeneous Clinical Study Data10.3389/fdata.2020.00016 ↗
26. Applications of Generative Adversarial Networks (GANs): An Updated Review10.1007/s11831-019-09388-y ↗
27. Hameed, K., Chai, D., and Rassau, A. (2021). Texture-based latent space disentanglement for enhancement of a training dataset for ANN-based classification of fruit and vegetables. Inf. Process. Agric., in press.
28. Vaccari, I., Orani, V., Paglialonga, A., Cambiaso, E., and Mongelli, M. (2021). A Generative Adversarial Network (GAN) Technique for Internet of Medical Things Data. Sensors, 21.10.3390/s21113726 ↗
29. Which GAN? A comparative study of generative adversarial network-based fast MRI reconstruction10.1098/rsta.2020.0203 ↗
30. Image based analysis of meibomian gland dysfunction using conditional generative adversarial neural network10.1136/bmjophth-2020-000436 ↗
31. Deep Learning for Anterior Segment Optical Coherence Tomography to Predict the Presence of Plateau Iris10.1167/tvst.10.1.7 ↗
32. Larsen, A.B.L., Sønderby, S.K., Larochelle, H., and Winther, O. (2016, January 20–22). Autoencoding beyond pixels using a learned similarity metric. Proceedings of the 33rd International Conference on Machine Learning, New York, NY, USA.
33. Baur, C., Wiestler, B., Albarqouni, S., and Navab, N. (2018, January 16). Deep Autoencoding Models for Unsupervised Anomaly Segmentation in Brain MR Images. Proceedings of the Conjunction with MICCAI 2018, Granada, Spain.10.1007/978-3-030-11723-8_16 ↗
34. Kwon, G., Han, C., and Kim, D. (2019, January 13–17). Generation of 3D Brain MRI Using Auto-Encoding Generative Adversarial Networks. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Shenzhen, China.10.1007/978-3-030-32248-9_14 ↗
35. Liu, M.Y., Huang, X., Yu, J., Wang, T.C., and Mallya, A. (2020). Generative Adversarial Networks for Image and Video Synthesis: Algorithms and Applications. arXiv.
36. Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., and Aila, T. (2020, January 13–19). Analyzing and Improving the Image Quality of StyleGAN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00813 ↗
37. GAN Computers Generate Arts? A Survey on Visual Arts, Music, and Literary Text Generation using Generative Adversarial Network10.1016/j.displa.2022.102237 ↗
38. Choi, E., Biswal, S., Malin, B., Duke, J., Stewart, W.F., and Sun, J. (2018). Generating Multi-label Discrete Patient Records using Generative Adversarial Networks. arXiv.
39. Subramanian, S., Rajeswar, S., Dutil, F., Pal, C., and Courville, A. (2017, January 3). Adversarial Generation of Natural Language. Proceedings of the 2nd Workshop on Representation Learning for NLP, Vancouver, BC, Canada.10.18653/v1/W17-2629 ↗
40. Ren, Y., Lin, J., Tang, S., Zhou, J., Yang, S., Qi, Y., and Ren, X. (2020). Generating Natural Language Adversarial Examples on a Large Scale with Generative Models. arXiv.10.18653/v1/P19-1103 ↗
41. Synthesizing electronic health records using improved generative adversarial networks10.1093/jamia/ocy142 ↗
42. Mendelevitch, O., and Lesh, M.D. (2021). Fidelity and Privacy of Synthetic Medical Data. arXiv.
43. Goncalves, A., Ray, P., Soper, B., Stevens, J., Coyle, L., and Sales, A.P. (2020). Generation and evaluation of synthetic patient data. BMC Med. Res. Methodol., 20.10.1186/s12874-020-00977-1 ↗
44. Zhao, Z., Kunar, A., Birke, R., and Chen, L.Y. (2021, January 18–24). CTAB-GAN: Effective Table Data Synthesizing. Proceedings of the 13th Asian Conference on Machine Learning, PMLR, Virtual.
45. Xu, L., Skoularidou, M., Cuesta-Infante, A., and Veeramachaneni, K. (2019). Modeling Tabular data using Conditional GAN. arXiv.
46. Gui, J., Sun, Z., Wen, Y., Tao, D., and Ye, J. (2020). A Review on Generative Adversarial Networks: Algorithms, Theory, and Applications. arXiv.
47. A survey of image synthesis and editing with generative adversarial networks10.23919/TST.2017.8195348 ↗
48. Pieters, M., and Wiering, M. (2018). Comparing Generative Adversarial Network Techniques for Image Creation and Modification. arXiv.
49. Audio Enhancement and Synthesis using Generative Adversarial Networks: A Survey
50. Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv.
51. Xu, L., and Veeramachaneni, K. (2018). Synthesizing Tabular Data using Generative Adversarial Networks. arXiv.
52. Kamthe, S., Assefa, S., and Deisenroth, M. (2021). Copula Flows for Synthetic Data Generation. arXiv.
53. Arjovsky, M., Chintala, S., and Bottou, L. (2017). Wasserstein GAN. arXiv.
54. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A. (2017). Improved Training of Wasserstein GANs. arXiv.
55. Conditional Wasserstein GAN-based Oversampling of Tabular Data for Imbalanced Learning10.1016/j.eswa.2021.114582 ↗
56. Wolberg, W., Street, W., and Mangasarian, O. (2022, May 10). Breast Cancer Wisconsin (Diagnostic); UCI Machine Learning Repository. Available online: https://archive-beta.ics.uci.edu/ml/datasets/breast+cancer+wisconsin+diagnostic.
57. Patrício, M., Pereira, J., Crisóstomo, J., Matafome, P., Gomes, M., Seiça, R., and Caramelo, F. (2022, May 10). Breast Cancer Coimbra; UCI Machine Learning Repository. Available online: https://archive.ics.uci.edu/ml/datasets/Breast+Cancer+Coimbra.
58. Performance Evaluation of Machine Learning Methods for Breast Cancer Prediction10.11648/j.acm.20180704.15 ↗
59. Patrício, M., Pereira, J., Crisóstomo, J., Matafome, P., Gomes, M., Seiça, R., and Caramelo, F. (2018). Using Resistin, glucose, age and BMI to predict the presence of breast cancer. BMC Cancer, 18.10.1186/s12885-017-3877-1 ↗
60. Comparison of Machine Learning Algorithms in Breast Cancer Prediction Using the Coimbra Dataset
61. Machine learning techniques to diagnose breast cancer from image-processed nuclear features of fine needle aspirates10.1016/0304-3835(94)90099-X ↗
62. Shahnaz, C., Hossain, J., Fattah, S.A., Ghosh, S., and Khan, A.I. (2017, January 21–23). Efficient approaches for accuracy improvement of breast cancer classification using wisconsin database. Proceedings of the 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC), Dhaka, Bangladesh.10.1109/R10-HTC.2017.8289075 ↗
63. Evaluating the Performance of Machine Learning Techniques in the Classification of Wisconsin Breast Cancer10.14419/ijet.v7i4.36.23737 ↗
64. Agarap, A.F.M. (2018, January 2–4). On breast cancer detection: An application of machine learning algorithms on the wisconsin diagnostic dataset. Proceedings of the 2nd International Conference on Machine Learning and Soft Computing—ICMLSC’18, Phu Quoc Island, Vietnam.10.1145/3184066.3184080 ↗
65. Model selection for support vector machines
66. A Multi-Dimensional Evaluation of Synthetic Data Generators10.1109/ACCESS.2022.3144765 ↗
67. Theis, L., Oord, A.v.d., and Bethge, M. (2015). A Note on the Evaluation of Generative Models. arXiv.
68. Reliability of Supervised Machine Learning Using Synthetic Data in Health Care: Model to Preserve Privacy for Data Sharing10.2196/18910 ↗