journal article·2020-11-04Open access

Ensemble Learning for Skeleton-Based Body Mass Index Classification

Beom Kwon, Sanghoon Lee

Applied Sciences· Volume 10· Issue 21

Abstract

In this study, we performed skeleton-based body mass index (BMI) classification by developing a unique ensemble learning method for human healthcare. Traditionally, anthropometric features, including the average length of each body part and average height, have been utilized for this kind of classification. Average values are generally calculated for all frames because the length of body parts and the subject height vary over time, as a result of the inaccuracy in pose estimation. Thus, traditionally, anthropometric features are measured over a long period. In contrast, we controlled the window used to measure anthropometric features over short/mid/long-term periods. This approach enables our proposed ensemble model to obtain robust and accurate BMI classification results. To produce final results, the proposed ensemble model utilizes multiple k-nearest neighbor classifiers trained using anthropometric features measured over several different time periods. To verify the effectiveness of the proposed model, we evaluated it using a public dataset. The simulation results demonstrate that the proposed model achieves state-of-the-art performance when compared with benchmark methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human Pose and Action Recognition · Body Composition Measurement Techniques · Gait Recognition and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Division of Network Business, Samsung Electronics Company, Ltd., Suwon 16677, Korea

Department of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea

References (54)

Show source-provided references
1. Relationship between obesity and diabetes in a US adult population: Findings from the national health and nutrition examination survey, 1999–200610.1007/s11695-010-0335-4 ↗
2. Association between obesity and high blood pressure: Reporting bias related to gender and age10.1038/sj.ijo.0800658 ↗
3. Association between obesity and hyperlipidemia among children
4. Cholelithiasis in morbid obesity10.1097/00007611-198404000-00002 ↗
5. Obesity and obstructive sleep apnea-hypopnea syndrome10.1111/j.1467-789X.2008.00478.x ↗
6. Obesity and arthritis10.1258/mi.2008.008018 ↗
7. Obesity and mental disorders in the adult general population10.1016/j.jpsychores.2007.09.006 ↗
8. Deciphering faces: Quantifiable visual cues to weight10.1068/p6560 ↗
9. Body mass index and facial cues in Sasang typology for young and elderly persons10.1155/2011/749209 ↗
10. A computational approach to body mass index prediction from face images10.1016/j.imavis.2013.03.001 ↗
11. Calculation of body mass index using image processing techniques
12. Amador, J.D., Cabrera, J.E., Cervantes, J., Jalili, L.D., and Castilla, J.S.R. (2018, January 17–19). Automatic calculation of body mass index using digital image processing. Proceedings of the Workshop on Engineering Applications (WEA), Medellín, Colombia.10.1007/978-3-030-00353-1_28 ↗
13. Application of artificial neural network and background subtraction for determining body mass index (BMI) in android devices using bluetooth10.7763/IJET.2016.V8.914 ↗
14. Pons-Moll, G., Baak, A., Helten, T., Müller, M., Seidel, H.P., and Rosenhahn, B. (2010, January 13–18). Multisensor-fusion for 3d full-body human motion capture. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.10.1109/CVPR.2010.5540153 ↗
15. Ganapathi, V., Plagemann, C., Koller, D., and Thrun, S. (2010, January 13–18). Real time motion capture using a single time-of-flight camera. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA.10.1109/CVPR.2010.5540141 ↗
16. Du, Y., Wong, Y., Liu, Y., Han, F., Gui, Y., Wang, Z., Kankanhalli, M., and Geng, W. (2016, January 11–14). Marker-less 3d human motion capture with monocular image sequence and height-maps. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46493-0_2 ↗
17. Lee, K., Lee, I., and Lee, S. (2018, January 8–14). Propagating LSTM: 3d pose estimation based on joint interdependency. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_8 ↗
18. Kwon, B., Kim, D., Kim, J., Lee, I., Kim, J., Oh, H., Kim, H., and Lee, S. (2015, January 16–18). Implementation of human action recognition system using multiple Kinect sensors. Proceedings of the 16th Pacific Rim Conference on Multimedia (PCM), Gwangju, Korea.10.1007/978-3-319-24075-6_32 ↗
19. Kwon, B., Kim, J., and Lee, S. (2016, January 13–16). An enhanced multi-view human action recognition system for virtual training simulator. Proceedings of the Asia–Pacific Signal and Information Processing Association Annual Summit Conference (APSIPA ASC), Jeju, Korea.10.1109/APSIPA.2016.7820895 ↗
20. Implementation of a virtual training simulator based on 360∘ multi-view human action recognition10.1109/ACCESS.2017.2723039 ↗
21. Lee, I., Kim, D., and Lee, S. (2020). 3D human behavior understanding using generalized TS-LSTM networks. IEEE Trans. Multimed.10.1109/TMM.2020.2978637 ↗
22. Wen, G., Wang, Z., Xia, S., and Zhu, D. (2006, January 1–3). From motion capture data to character animation. Proceedings of the ACM Symposium on Virtual Reality Software and Technology (VRST), Limassol, Cyprus.10.1145/1180495.1180528 ↗
23. Zhang, X., Biswas, D.S., and Fan, G. (2010, January 5–7). A software pipeline for 3D animation generation using mocap data and commercial shape models. Proceedings of the ACM International Conference on Image and Video Retrieval (CIVR), Xi’an, China.10.1145/1816041.1816092 ↗
24. Automatic generation of human animation based on motion programming10.1002/cav.109 ↗
25. Kwon, B., Huh, J., Lee, K., and Lee, S. (2020). Optimal camera point selection toward the most preferable view of 3D human pose. IEEE Trans. Syst. Man Cybern. Syst.
26. Action and gait recognition from recovered 3-D human joints10.1109/TSMCB.2010.2043526 ↗
27. Skeleton-based gait recognition via robust frame-level matching10.1109/TIFS.2019.2901823 ↗
28. Andersson, V.O., Amaral, L.S., Tonini, A.R., and Araujo, R.M. (2015, January 18–20). Gender and body mass index classification using a Microsoft Kinect sensor. Proceedings of the 28th International Florida Artificial Intelligence Research Society (FLAIRS) Conference, Hollywood, FL, USA.
29. Kocabey, E., Camurcu, M., Ofli, F., Aytar, Y., Marin, J., Torralba, A., and Weber, I. (2017, January 15–18). Face-to-BMI: Using computer vision to infer body mass index on social media. Proceedings of the International AAAI Conference on Web and Social Media (ICWSM), Montreal, Canada.10.1609/icwsm.v11i1.14923 ↗
30. Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7–10). Deep face recognition. Proceedings of the British Machine Vision Conference (BMVC) 2015, Swansea, UK.10.5244/C.29.41 ↗
31. A survey of shape feature extraction techniques
32. Nahavandi, D., Abobakr, A., Haggag, H., Hossny, M., Nahavandi, S., and Filippidis, D. (2017, January 11–13). A skeleton-free Kinect system for body mass index assessment using deep neural networks. Proceedings of the IEEE International Systems Engineering Symposium (ISSE), Vienna, Austria.10.1109/SysEng.2017.8088252 ↗
33. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
34. Simple formula for the surface area of the body and a simple model for anthropometry10.1002/ca.20047 ↗
35. Learning from imbalanced data10.1109/TKDE.2008.239 ↗
36. A review of class imbalance problem
37. Classification with class imbalance problem: A review
38. A study of the behavior of several methods for balancing machine learning training data10.1145/1007730.1007735 ↗
39. Van Hulse, J., Khoshgoftaar, T.M., and Napolitano, A. (2009, January 10–12). An empirical comparison of repetitive undersampling techniques. Proceedings of the IEEE International Conference on Information Reuse & Integration, Las Vegas, NV, USA.10.1109/IRI.2009.5211614 ↗
40. An overview of classification algorithms for imbalanced datasets
41. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
42. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. (2011, January 20–25). Real-time human pose recognition in parts from single depth images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.10.1109/CVPR.2011.5995316 ↗
43. Araujo, R., Graña, G., and Andersson, V. (2013, January 18–22). Towards skeleton biometric identification using the Microsoft Kinect sensor. Proceedings of the 28th Symposium on Applied Computing (SAC), Coimbra, Portugal.10.1145/2480362.2480369 ↗
44. Andersson, V., Dutra, R., and Araujo, R. (2014, January 24–28). Anthropometric and human gait identification using skeleton data from Kinect sensor. Proceedings of the 29th Symposium on Applied Computing (SAC), Gyeongju, Korea.10.1145/2554850.2555147 ↗
45. Andersson, V., and Araujo, R. (2014, January 10–12). Full body person identification using the Kinect sensor. Proceedings of the 26th IEEE International Conference on Tools with Artificial Intelligence (ICTAI), Limassol, Cyprus.10.1109/ICTAI.2014.99 ↗
46. Andersson, V., and Araujo, R. (2015, January 25–30). Person identification using anthropometric and gait data from Kinect sensor. Proceedings of the 29th Association for the Advancement of Artificial Intelligence (AAAI) Conference on Artificial Intelligence, Austin, TX, USA.10.1609/aaai.v29i1.9212 ↗
47. Relative distance features for gait recognition with Kinect10.1016/j.jvcir.2016.05.020 ↗
48. Gait recognition using fuzzy ontologies and Kinect sensor data10.1016/j.ijar.2019.07.012 ↗
49. View-invariant gait recognition based on Kinect skeleton feature10.1007/s11042-018-5722-1 ↗
50. Kwon, B., and Lee, S. (2020). Human skeleton data augmentation for person identification over deep neural network. Appl. Sci., 10.10.3390/app10144849 ↗
51. LIBSVM: A library for support vector machines10.1145/1961189.1961199 ↗
52. Hsu, C.W., Chang, C.C., and Lin, C.J. (2003). A Practical Guide to Support Vector Classification, National Taiwan University.
53. Wang, Q., Kurillo, G., Ofli, F., and Bajcsy, R. (2015, January 21–23). Evaluation of pose tracking accuracy in the first and second generations of microsoft kinect. Proceedings of the IEEE International Conference on Healthcare Informatics, Dallas, TX, USA.10.1109/ICHI.2015.54 ↗
54. Albert, J.A., Owolabi, V., Gebel, A., Brahms, C.M., Granacher, U., and Arnrich, B. (2020). Evaluation of the pose tracking performance of the Azure Kinect and Kinect v2 for gait analysis in comparison with a gold standard: A pilot study. Sensors, 20.10.3390/s20185104 ↗