Predicting Post-Liposuction Body Shape Using RGB Image-to-Image Translation
Source abstract
Abstract
The growing interest in weight management has elevated the popularity of liposuction. Individuals deciding whether to undergo liposuction must rely on a doctor’s subjective projections or surgical outcomes for other people to gauge how their own body shape will change. However, such predictions may not be accurate. Although deep learning technology has recently achieved breakthroughs in analyzing medical images and rendering diagnoses, predicting surgical outcomes based on medical images outside clinical settings remains challenging. Hence, this study aimed to develop a method for predicting body shape changes after liposuction using only images of the subject’s own body. To achieve this, we utilize data augmentation based on a conditional continuous Generative Adversarial Network (CcGAN), which generates realistic synthetic data conditioned on continuous variables. Additionally, we modify the loss function of Pix2Pix—a supervised image-to-image translation technique based on Generative Adversarial Networks (GANs)—to enhance prediction quality. Our approach quantitatively and qualitatively demonstrates that accurate, intuitive predictions before liposuction are possible.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Body Contouring and Surgery · Skin Diseases and Diabetes · Infrared Thermography in Medicine
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial and Systems Engineering, Dongguk University, Seoul 04620, Republic of Korea
Funding
National Research Foundation of Korea
References (49)
Show source-provided references
1. Kim, Y.J. (2006). Effects of Liposuction on Body Image, Self-Esteem, and Satisfaction with Outcomes. [Master’s Thesis, Department of Occupational Health, Yonsei University].
2. Current and future photography techniques in aesthetic surgery10.1093/asjof/ojab050 ↗
3. Machine learning approaches for prediction of facial rejuvenation using real and synthetic data10.1109/ACCESS.2019.2899379 ↗
4. 365mc.co.kr (2022, March 30). 365MC. Available online: http://www.365mc.co.kr/diettest/pc/?src=image&kw=000022&route=WCDTEST_H.
5. Babajide, B.O., Hissam, T., Anna, A.P., Anatoliy, A.G., Astrup, A.J., and Martinez, J.A. (2020). A machine learning approach to short-term body weight prediction in a dietary intervention program. Computational Science–ICCS 2020: Proceedings of the 20th International Conference, Amsterdam, The Netherlands, 3–5 June 2020, Springer. Proceedings, Part IV.10.1007/978-3-030-50423-6_33 ↗
6. Weber, I., and Achananuparp, P. (2016). Insights from machine-learned diet success prediction. Biocomputing 2016: Proceedings of the Pacific Symposium, Kohala Coast, HI, USA, 4–8 January 2016, World Scientific.10.1142/9789814749411_0049 ↗
7. Adherence to an overweight and obesity treatment: How to motivate a patient?10.7717/peerj.495 ↗
8. Zeng, Y., Fu, J., and Chao, H. (2018). 3D human body reshaping with anthropometric modeling. Internet Multimedia Computing and Service, Proceedings of the 9th International Conference, ICIMCS 2017, Qingdao, China, 23–25 August 2017, Springer. Revised Selected Papers.10.1007/978-981-10-8530-7_10 ↗
9. Karras, T., Laine, S., and Aila, T. (2019, January 15–20). A style-based generator architecture for generative adversarial networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00453 ↗
10. Karras, T., Laine, S., Aittala, M., Hellsten, J., Lehtinen, J., and Aila, T. (2020, January 13–19). Analyzing and improving the image quality of StyleGAN. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00813 ↗
11. Dong, G., and Basu, A. (2022). Unsupervised Face Frontalization GAN Driven by 3D Rotation and Symmetric Filling. International Conference on Smart Multimedia, Springer International Publishing.10.1007/978-3-031-22061-6_5 ↗
12. Generative adversarial nets
13. Yoo, T.K., Choi, J.Y., and Kim, H.K. (2020). A generative adversarial network approach to predicting postoperative appearance after orbital decompression surgery for thyroid eye disease. Comput. Biol. Med., 118.10.1016/j.compbiomed.2020.103628 ↗
14. Overview of image-to-image translation by use of deep neural networks: Denoising, super-resolution, modality conversion, and reconstruction in medical imaging10.1007/s12194-019-00520-y ↗
15. Wang, Q., Xue, W., Zhang, X., Jin, F., and Hahn, J. (2021). Pixel-wise body composition prediction with a multi-task conditional generative adversarial network. J. Biomed. Inform., 120.10.1016/j.jbi.2021.103866 ↗
16. Image-to-image translation for multi-task organ segmentation and bone suppression in chest X-ray radiography10.1109/TMI.2020.2974159 ↗
17. Potential role of artificial intelligence in craniofacial surgery10.7181/acfs.2021.00507 ↗
18. Isola, P., Zhu, J.-Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
19. Synthesizing multi-contrast MR images via novel 3D conditional variational auto-encoding GAN10.1007/s11036-020-01678-1 ↗
20. Armanious, K., Kumar, V., Abdulatif, S., Hepp, T., Gatidis, S., and Yang, B. (2020, January 25–28). ipA-MedGAN: Inpainting of arbitrary regions in medical imaging. Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, United Arab Emirates.10.1109/ICIP40778.2020.9191207 ↗
21. Choi, Y., Choi, M., Kim, M., Ha, J.-W., Kim, S., and Choo, J. (2018, January 18–23). StarGAN: Unified generative adversarial networks for multi-domain image-to-image translation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00916 ↗
22. The effectiveness of data augmentation in image classification using deep learning
23. Shi, H., Wang, L., Ding, G., Yang, F., and Li, X. (2018, January 20–24). Data augmentation with improved generative adversarial networks. Proceedings of the 2018 24th International Conference on Pattern Recognition (ICPR), Beijing, China.10.1109/ICPR.2018.8545894 ↗
24. Interest in cosmetic surgery and body image: Views of men and women across the lifespan10.1097/01.prs.0000279375.26157.64 ↗
25. Modified tumescent liposuction10.1046/j.1524-4725.1999.99018.x ↗
26. Body mass index: Obesity, BMI, and health: A critical review10.1097/NT.0000000000000092 ↗
27. World Health Organization (1995). Physical Status: The Use and Interpretation of Anthropometry. Report of a WHO Expert Committee, World Health Organization.
28. Altman, D.G. (1990). Practical Statistics for Medical Research, CRC Press.10.1201/9780429258589 ↗
29. The correlation coefficient: Its values range between +1/−1, or do they?10.1057/jt.2009.5 ↗
30. Ding, X., Wang, Y., Xu, Z., Welch, W.J., and Wang, Z.J. (2020, January 26–30). CcGAN: Continuous conditional generative adversarial networks for image generation. Proceedings of the International Conference on Learning Representations, Addis Ababa, Ethiopia.
31. InfoGAN: Interpretable representation learning by information maximizing generative adversarial nets
32. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
33. Deng, J., Dong, W., Socher, R., Li, L.-J., Li, K., and Fei-Fei, L. (2009, January 20–25). ImageNet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
34. Kodirov, E., Xiang, T., and Gong, S. (2017, January 21–26). Semantic autoencoder for zero-shot learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.473 ↗
35. Zhu, J.-Y., Krähenbühl, P., Shechtman, E., and Efros, A.A. (2016). Generative visual manipulation on the natural image manifold. European Conference on Computer Vision, Springer.10.1007/978-3-319-46454-1_36 ↗
36. Transient attributes for high-level understanding and editing of outdoor scenes10.1145/2601097.2601101 ↗
37. Mirza, M., and Osindero, S. (2014). Conditional generative adversarial nets. arXiv.
38. Ronneberger, O., Fischer, P., and Brox, T. (2015). U-Net: Convolutional networks for biomedical image segmentation. International Conference on Medical Image Computing and Computer-Assisted Intervention, Springer.10.1007/978-3-319-24574-4_28 ↗
39. An end-to-end brain tumor segmentation system using multi-inception-UNET10.1002/ima.22585 ↗
40. Amer, A., Ye, X., Zolgharni, M., and Janan, F. (2020, January 20–24). ResDUnet: Residual dilated UNet for left ventricle segmentation from echocardiographic images. Proceedings of the 2020 42nd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9175436 ↗
41. Johnson, J., Alahi, A., and Fei-Fei, L. (2016). Perceptual losses for real-time style transfer and super-resolution. European Conference on Computer Vision, Springer.10.1007/978-3-319-46475-6_43 ↗
42. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
43. Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18–23). The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00068 ↗
44. ImageNet classification with deep convolutional neural networks
45. Image quality assessment: From error visibility to structural similarity10.1109/TIP.2003.819861 ↗
46. Scope of validity of PSNR in image/video quality assessment10.1049/el:20080522 ↗
47. Indices of relative weight and obesity10.1016/0021-9681(72)90027-6 ↗
48. Relationships between the body mass index and body composition10.1002/j.1550-8528.1996.tb00510.x ↗
49. Comparison of the Bod Pod and dual-energy X-ray absorptiometry in men10.1088/0967-3334/25/3/007 ↗