Challenges of Using Synthetic Data Generation Methods for Tabular Microdata
Source abstract
Abstract
The generation of synthetic data holds significant promise for augmenting limited datasets while avoiding privacy issues, facilitating research, and enhancing machine learning models’ robustness. Generative Adversarial Networks (GANs) stand out as promising tools, employing two neural networks—generator and discriminator—to produce synthetic data that mirrors real data distributions. This study evaluates GAN variants (CTGAN, CopulaGAN), a variational autoencoder, and copulas on diverse real datasets of different complexity encompassing numerical and categorical attributes. The results highlight CTGAN’s sensitivity to training parameters and TVAE’s robustness across datasets. Scalability challenges persist, with GANs demanding substantial computational resources. TVAE stands out for its high utility across all datasets, even for high-dimensional data, though it incurs higher privacy risks, which is indicative of the curse of dimensionality. While no single model universally excels, understanding the trade-offs and leveraging model strengths can significantly enhance synthetic data generation (SDG). Future research should focus on adaptive learning mechanisms, scalability enhancements, and standardized evaluation metrics to advance SDG methods effectively. Addressing these challenges will foster broader adoption and application of synthetic data.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Privacy-Preserving Technologies in Data · Data Quality and Management · Human Mobility and Location-Based Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Engineering and Computer Science, Bern University of Applied Sciences, Quellgasse 21, 2502 Bienne, Switzerland
Funding
Swiss National Science Foundation SNSF and Innosuisse
References (35)
Show source-provided references
1. The FAIR guiding principles for data stewardship: Fair enough?10.1038/s41431-018-0160-0 ↗
2. Biomedical data privacy: Problems, perspectives, and recent advances10.1136/amiajnl-2012-001509 ↗
3. Practical Tips for Ethical Data Sharing10.1177/2515245917747656 ↗
4. A systematic overview on methods to protect sensitive data provided for various analyses10.1007/s10207-022-00607-5 ↗
5. Harnessing the power of synthetic data in healthcare: Innovation, application, and privacy10.1038/s41746-023-00927-3 ↗
6. Anonymization Through Data Synthesis Using Generative Adversarial Networks (ADS-GAN)10.1109/JBHI.2020.2980262 ↗
7. Working with missing values10.1111/j.1741-3737.2005.00191.x ↗
8. Handling missing values when applying classification models
9. Abedi, M., Hempel, L., Sadeghi, S., and Kirsten, T. (2022). GAN-Based Approaches for Generating Structured Data in the Medical Domain. Appl. Sci., 12.10.3390/app12147075 ↗
10. Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Models10.1109/TPAMI.2021.3116668 ↗
11. synthpop: Bespoke Creation of Synthetic Data in R10.18637/jss.v074.i11 ↗
12. Simulation of Synthetic Complex Data: The R Package simPop10.18637/jss.v079.i10 ↗
13. A survey on GANs for computer vision: Recent research, analysis and taxonomy10.1016/j.cosrev.2023.100553 ↗
14. Data augmentation for handwritten digit recognition using generative adversarial networks10.1007/s11042-020-08883-w ↗
15. Xu, L., Skoularidou, M., Cuesta-Infante, A., and Veeramachaneni, K. (2019). Modeling Tabular data using Conditional GAN. arXiv.
16. (2024, June 16). CopulaGAN Model—SDV 0.18.0 Documentation. Available online: https://sdv.dev/SDV/user_guides/single_table/copulagan.html.
17. Nelsen, R.B. (2007). An Introduction to Copulas: With 116 Examples and 167 Exercises, Springer. [2nd ed.]. 2006 Edition.
18. Hofert, M., Kojadinovic, I., Mächler, M., and Yan, J. (2019). Elements of Copula Modeling with R, Springer. [1st ed.]. 2018 Edition.10.1007/978-3-319-89635-9 ↗
19. Patki, N., Wedge, R., and Veeramachaneni, K. (2016, January 17–19). The Synthetic Data Vault. Proceedings of the 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA), Montreal, QC, Canada. Available online: https://ieeexplore.ieee.org/document/7796926.10.1109/DSAA.2016.49 ↗
20. On the Relation Between Identifiability, Differential Privacy, and Mutual-Information Privacy10.1109/TIT.2016.2584610 ↗
21. Jordon, J., Yoon, J., and van der Schaar, M. (2023, December 11). PATE-GAN: Generating Synthetic Data with Differential Privacy Guarantees. Available online: https://openreview.net/forum?id=S1zk9iRqF7.
22. Synthetic Data: Methods, Use Cases, and Risks10.1109/MSEC.2024.3371505 ↗
23. Torra, V., Narukawa, Y., Pasi, G., and Viviani, M. (2019). Mitigating the Curse of Dimensionality in Data Anonymization. Modeling Decisions for Artificial Intelligence, Springer International Publishing.10.1007/978-3-030-26773-5 ↗
24. Aggarwal, C.C., and Yu, P.S. (2008). Privacy and the Dimensionality Curse. Privacy-Preserving Data Mining: Models and Algorithms, Springer.10.1007/978-0-387-70992-5 ↗
25. Salehi, P., Chalechale, A., and Taghizadeh, M. (2020). Generative Adversarial Networks (GANs): An Overview of Theoretical Model, Evaluation Metrics, and Recent Developments. arXiv.
26. Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6–11). Wasserstein Generative Adversarial Networks. Proceedings of the 34th International Conference on Machine Learning, PMLR, Sydney, Australia. Available online: https://proceedings.mlr.press/v70/arjovsky17a.html.
27. Stanczuk, J., Etmann, C., Kreusser, L.M., and Schönlieb, C.B. (2021). Wasserstein GANs Work Because They Fail (to Approximate the Wasserstein Distance). arXiv.
28. A Survey of Generative Adversarial Networks for Synthesizing Structured Electronic Health Records10.1145/3636424 ↗
29. Machine learning-based prediction of mortality after heart transplantation in adults with congenital heart disease: A UNOS database analysis10.1111/ctr.14845 ↗
30. Use and Understanding of Anonymization and De-Identification in the Biomedical Literature: Scoping Review10.2196/13484 ↗
31. Zhang, Z., Li, M., and Yu, J. (2018). On the convergence and mode collapse of GAN. SA’18 SIGGRAPH Asia 2018 Technical Briefs, Association for Computing Machinery.10.1145/3283254.3283282 ↗
32. Bugliesi, M., Preneel, B., Sassone, V., and Wegener, I. (2006). Differential Privacy. Automata, Languages and Programming, Springer.10.1007/11786986 ↗
33. The limits of differential privacy (and its misuse in data release and machine learning)10.1145/3433638 ↗
34. Zhang, Z., Yan, C., and Malin, B.A. (2022). Membership inference attacks against synthetic health data. J. Biomed. Inform., 125.10.1016/j.jbi.2021.103977 ↗
35. Saxena, D., and Cao, J. (2023). Generative Adversarial Networks (GANs Survey): Challenges, Solutions, and Future Directions. arXiv.