journal article·2023-09-08Open access

Local Differential Privacy Image Generation Using Flow-Based Deep Generative Models

Hisaichi Shibata, Shouhei Hanaoka, Yang Cao, Masatoshi Yoshikawa, Tomomi Takenaga, Yukihiro Nomura, Naoto Hayashi, Osamu Abe

Applied Sciences· Volume 13· Issue 18

Abstract

Diagnostic radiologists need artificial intelligence (AI) for medical imaging, but access to medical images required for training in AI has become increasingly restrictive. To release and use medical images, we need an algorithm that can simultaneously protect privacy and preserve pathologies in medical images. To address this, we introduce DP-GLOW, a hybrid that combines the local differential privacy (LDP) algorithm with GLOW, one of the flow-based deep generative models. By applying a GLOW model, we disentangle the pixelwise correlation of images, which makes it difficult to protect privacy with straightforward LDP algorithms for images. Specifically, we map images to the latent vector of the GLOW model, where each element follows an independent normal distribution. We then apply the Laplace mechanism to this latent vector to achieve ϵ-LDP, which is one of the LDP algorithms. Moreover, we applied DP-GLOW to chest X-ray images to generate LDP images while preserving pathologies. The ϵ-LDP-processed chest X-ray images obtained with DP-GLOW indicate that we have obtained a powerful tool for releasing and using medical images for training AI.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Privacy-Preserving Technologies in Data · Generative Adversarial Networks and Image Synthesis · Face recognition and analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan

Graduate School of Information Science and Technology, Hokkaido University, Kita 14, Nishi 9, Kita-ku, Sapporo 060-0814, Japan

Faculty of Data Science, Osaka Seikei University, 1-3-7 Aikawa, Higashiyodogawa-ku, Osaka 533-0007, Japan

Center for Frontier Medical Engineering, Chiba University, 1-33 Yayoi-cho, Inage-ku, Chiba 263-8522, Japan

Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-8655, Japan

Funding

JST

References (19)

Show source-provided references
1. (2022, November 01). Alzheimer’s Disease Neuroimaging Initiative. Available online: https://adni.loni.usc.edu/.
2. Dwork, C. (2008, January 25–29). Differential privacy: A survey of results. Proceedings of the International Conference on Theory and Applications of Models Of Computation, Xi’an, China.
3. Erlingsson, Ú., Pihur, V., and Korolova, A. (2014, January 3–7). Rappor: Randomized aggregatable privacy-preserving ordinal response. Proceedings of the 2014 ACM SIGSAC Conference on Computer and Communications Security, Scottsdale, AZ, USA.10.1145/2660267.2660348 ↗
4. Abadi, M., Chu, A., Goodfellow, I., McMahan, H.B., Mironov, I., Talwar, K., and Zhang, L. (2016, January 24–28). Deep learning with differential privacy. Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, Vienna, Austria.10.1145/2976749.2978318 ↗
5. Medical imaging deep learning with differential privacy10.1038/s41598-021-93030-0 ↗
6. Toward Sharing Brain Images: Differentially Private TOF-MRA Images with Segmentation Labels Using Generative Adversarial Networks10.3389/frai.2022.813842 ↗
7. Fan, L. (2018, January 16–18). Image pixelization with differential privacy. Proceedings of the IFIP Annual Conference on Data and Applications Security and Privacy, Bergamo, Italy.10.1007/978-3-319-95729-6_10 ↗
8. Fan, L. (2019, January 11). Differential privacy for image publication. Proceedings of the Theory and Practice of Differential Privacy (TPDP) Workshop, London, UK.
9. Obfuscation of images via differential privacy: From facial images to general images
10. Liu, B., Ding, M., Xue, H., Zhu, T., Ye, D., Song, L., and Zhou, W. (2021). DP-Image: Differential Privacy for Image Data in Feature Space. arXiv.
11. Li, T., and Clifton, C. (2021). Differentially private imaging via latent space manipulation. arXiv.
12. Differentially private facial obfuscation via generative adversarial networks10.1016/j.future.2021.11.032 ↗
13. Glow: Generative flow with invertible 1x1 convolutions
14. Augmenting the national institutes of health chest radiograph dataset with expert annotations of possible pneumonia10.1148/ryai.2019180041 ↗
15. Dinh, L., Krueger, D., and Bengio, Y. (2014). Nice: Non-linear independent components estimation. arXiv.
16. Dinh, L., Sohl-Dickstein, J., and Bengio, S. (2016). Density estimation using real nvp. arXiv.
17. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv.
18. Shibata, H., Hanaoka, S., Nakao, T., Kikuchi, T., Nakamura, Y., Nomura, Y., Yoshikawa, T., and Abe, O. (2023). Practical Medical Image Generation with Provable Privacy Protection based on Denoising Diffusion Probabilistic Models for High-resolution Volumetric Images. TechRxiv.10.36227/techrxiv.23849373 ↗
19. Versatile anomaly detection method for medical images with semi-supervised flow-based generative models10.1007/s11548-021-02480-4 ↗