GolfMate: Enhanced Golf Swing Analysis Tool through Pose Refinement Network and Explainable Golf Swing Embedding for Self-Training
Source abstract
Abstract
Digital fitness has become a widely used tool for remote exercise guidance, leveraging artificial intelligence to analyze exercise videos and support self-training. This paper introduces a method for self-training in golf, a sport where automated posture analysis can significantly reduce the costs associated with professional coaching. Our system utilizes a pose refinement methodology and an explainable golf swing embedding for analyzing the swing motions of learners and professional golfers. By leveraging sequential coordinate information, we detect biased pose joints and refine the 2D and 3D human pose estimation results. Furthermore, we propose a swing embedding method that considers geometric information extracted from the swing pose. This approach enables not only the comparison of the similarity between two golf swing poses but also the visualization of different points, providing learners with specific and intuitive feedback on areas that require correction. Our experimental results demonstrate the effectiveness of our swing guide system in identifying specific body points that need adjustment to align more closely with a professional golfer’s swing. This research contributes to the digital fitness domain by enhancing the accuracy of posture analysis and providing a specialized and interpretable golf swing analysis system. Our proposed system offers a low-cost and time-efficient approach for users who wish to improve their golf swing, paving the way for broader applications of digital fitness technologies in self-training contexts.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sports Dynamics and Biomechanics · Human Pose and Action Recognition · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Applied Artificial Intelligence Major in Bio Artificial Intelligence, Hanyang University, Ansan 15588, Republic of Korea
Funding
Institute of Information & Communications Technology Planning & Evaluation (IITP) funded by the Korea government (MSIT) · Artificial Intelligence Convergence Innovation Human Resources Development (Hanyang University ERICA) · National Research Foundation of Korea (NRF) funded by the Korea government (MSIT)
References (27)
Show source-provided references
1. Hoang, T.N., Reinoso, M., Vetere, F., and Tanin, E. (2016, January 23–27). Onebody: Remote posture guidance system using first person view in virtual environment. Proceedings of the 9th Nordic Conference on Human-Computer Interaction, Gothenburg, Sweden.10.1145/2971485.2971521 ↗
2. Liao, C.-C., Hwang, D.-H., and Koike, H. (2021, January 14–17). How can i swing like pro? Golf swing analysis tool for self training. Proceedings of the SA’21: SIGGRAPH Asia 2021, Tokyo, Japan.10.1145/3476124.3488645 ↗
3. Han, P.-H., Chen, Y.-S., Zhong, Y., Wang, H.-L., and Hung, Y.-P. (2017, January 16–18). My Tai-Chi coaches: An augmented-learning tool for practicing Tai-Chi Chuan. Proceedings of the 8th Augmented Human International Conference, Silicon Valley, CA, USA.10.1145/3041164.3041194 ↗
4. Kuramoto, I., Nishimura, Y., Yamamoto, K., Shibuya, Y., and Tsujino, Y. (September, January 31). Visualizing velocity and acceleration on augmented practice mirror self-learning support system of physical motion. Proceedings of the 2013 Second IIAI International Conference on Advanced Applied Informatics, Los Alamitos, CA, USA.10.1109/IIAI-AAI.2013.28 ↗
5. An approach to ballet dance training through MS Kinect and visualization in a CAVE virtual reality environment10.1145/2735951 ↗
6. AI Golf: Golf Swing Analysis Tool for Self-Training10.1109/ACCESS.2022.3210261 ↗
7. Liao, C.-C., Hwang, D.-H., Wu, E., and Koike, H. (2023, January 12–14). AI Coach: A Motor Skill Training System using Motion Discrepancy Detection. Proceedings of the Augmented Humans International Conference, Glasgow, UK.10.1145/3582700.3582710 ↗
8. Deep learning based 2d human pose estimation: A survey10.26599/TST.2018.9010100 ↗
9. Bazarevsky, V., Grishchenko, L., Raveendran, K., Zhu, T., Zhang, F., and Grundmann, M. (2020). BlazePose: On-device real-time body pose tracking. arXiv.
10. Sun, K., Xiao, B., Liu, D., and Wang, J. (2019, January 15–20). Deep high-resolution representation learning for human pose estimation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00584 ↗
11. OpenPose: Realtime multi-person 2D pose estimation using part affinity fields10.1109/TPAMI.2019.2929257 ↗
12. A lightweight top-down multi-person pose estimation method based on symmetric transformation and global matching10.1109/ACCESS.2022.3151136 ↗
13. Vitpose: Simple vision transformer baselines for human pose estimation
14. Moon, G., Chang, J.Y., and Lee, K.M. (2019, January 15–20). Posefix: Model-agnostic general human pose refinement network. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00796 ↗
15. Newell, A., Yang, K., and Deng, J. (2016, January 11–14). Stacked hourglass networks for human pose estimation. Proceedings of the European Conference on Computer Vision 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46484-8_29 ↗
16. Bulat, A., and Tzimiropoulos, G. (2016, January 11–14). Human pose estimation via convolutional part heatmap regression. Proceedings of the European Conference on Computer Vision 2016, Amsterdam, The Netherlands.10.1007/978-3-319-46478-7_44 ↗
17. Wei, S.E., Ramakrishna, V., Kanade, T., and Sheikh, Y. (2016, January 27–30). Convolutional pose machines. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.511 ↗
18. Chen, Y., Wang, Z., Peng, Y., Zhang, Z., Yu, G., and Sun, J. (2018, January 18–23). Cascaded pyramid network for multi-person pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00742 ↗
19. Carreira, J., Agrawal, P., Fragkiadaki, K., and Malik, J. (2016, January 27–30). Human pose estimation with iterative error feedback. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.512 ↗
20. Cai, Y., Wang, Z., Luo, Z., Yin, B., Du, A., Wang, H., Zhang, X., Zhou, X., Zhou, E., and Sun, J. (2020, January 23–28). Learning delicate local representations for multi-person pose estimation. Proceedings of the European Conference on Computer Vision 2020, Glasgow, UK.10.1007/978-3-030-58580-8_27 ↗
21. Wang, J., Long, X., Gao, Y., Ding, E., and Wen, S. (2020, January 23–28). Graph-pcnn: Two stage human pose estimation with graph pose refinement. Proceedings of the European Conference on Computer Vision 2020, Glasgow, UK.10.1007/978-3-030-58621-8_29 ↗
22. Fieraru, M., Khoreva, A., Pishchulin, L., and Schiele, B. (2018, January 16). Learning to refine human pose estimation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00058 ↗
23. Pose refinement graph convolutional network for skeleton-based action recognition10.1109/LRA.2021.3056361 ↗
24. Video Call-based Fitness Assessment shows Poor Fitness in People with Type II Diabetes: Findings from Diabefly Digital Therapeutics Program
25. Dancing on the inside: A qualitative study on online dance learning with teacher-AI cooperation10.1007/s10639-023-11649-0 ↗
26. Marcard, T.V., Henschel, R., Black, M.J., Rosenhahn, B., and Pons-Moll, G. (2018, January 8–14). Recovering accurate 3D human pose in the wild using imus and a moving camera. Proceedings of the European Conference on Computer Vision (ECCV) 2018, Munich, Germany.
27. PGA TOUR (2023, July 12). Official World Golf Ranking. Available online: https://www.pgatour.com/tournaments/2023/tour-championship/R2023060/leaderboard.