Posture Detection of Heart Disease Using Multi-Head Attention Vision Hybrid (MHAVH) Model
Source abstract
Abstract
Cardiovascular disease is the leading cause of death globally. This disease causes loss of heart muscles and is also responsible for the death of heart cells, sometimes damaging their functionality. A person’s life may depend on receiving timely assistance as soon as possible. Thus, minimizing the death ratio can be achieved by early detection of heart attack (HA) symptoms. In the United States alone, an estimated 610,000 people die from heart attacks each year, accounting for one in every four fatalities. However, by identifying and reporting heart attack symptoms early on, it is possible to reduce damage and save many lives significantly. Our objective is to devise an algorithm aimed at helping individuals, particularly elderly individuals living independently, to safeguard their lives. To address these challenges, we employ deep learning techniques. We have utilized a vision transformer (ViT) to address this problem. However, it has a significant overhead cost due to its memory consumption and computational complexity because of scaling dot-product attention. Also, since transformer performance typically relies on large-scale or adequate data, adapting ViT for smaller datasets is more challenging. In response, we propose a three-in-one steam model, the Multi-Head Attention Vision Hybrid (MHAVH). This model integrates a real-time posture recognition framework to identify chest pain postures indicative of heart attacks using transfer learning techniques, such as ResNet-50 and VGG-16, renowned for their robust feature extraction capabilities. By incorporating multiple heads into the vision transformer to generate additional metrics and enhance heart-detection capabilities, we leverage a 2019 posture-based dataset comprising RGB images, a novel creation by the author that marks the first dataset tailored for posture-based heart attack detection. Given the limited online data availability, we segmented this dataset into gender categories (male and female) and conducted testing on both segmented and original datasets. The training accuracy of our model reached an impressive 99.77%. Upon testing, the accuracy for male and female datasets was recorded at 92.87% and 75.47%, respectively. The combined dataset accuracy is 93.96%, showcasing a commendable performance overall. Our proposed approach demonstrates versatility in accommodating small and large datasets, offering promising prospects for real-world applications.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: COVID-19 diagnosis using AI · AI and Big Data Applications · Traditional Chinese Medicine Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (46)
Show source-provided references
1. Heart attack detection by heartbeat sensing using Internet of Things: IoT
2. Word Health Organization, “The top 10 causes of death,” WHO. Accessed: Mar. 18, 2024. [Online]. Available: https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death
3. Heart attack detection in colour images using convolutional neural networks10.3390/app9235065 ↗
4. Inceptr: Micro-expression recognition integrating inception-CBAM and vision transformer10.1007/s00530-023-01164-0 ↗
5. Opportunities and challenges of artificial intelligence and distributed systems to improve the quality of healthcare service10.1016/j.artmed.2024.102779 ↗
6. An improved deep learning approach for heart attack detection from digital images
7. The deep learning applications in IoT-based bio-and medical informatics: A systematic literature review10.1007/s00521-023-09366-3 ↗
8. Cooperative hierarchical framework for group activity recognition: From group detection to multi-activity recognition
9. Power mean based image segmentation in the presence of noise10.1038/s41598-022-25250-x ↗
10. A hybrid intelligent system framework for the prediction of heart disease using machine learning algorithms
11. ECG-based machine-learning algorithms for heartbeat classification10.1038/s41598-021-97118-5 ↗
12. MR imaging in the 21st century: Technical innovation over the first two decades10.2463/mrms.rev.2021-0011 ↗
13. A. Trockman and J. Z. Kolter, “Patches are all you need?,” arXiv preprint arXiv:2201.09792, 2022.
14. Survey on deep learning with class imbalance10.1186/s40537-019-0192-5 ↗
15. BDCNet: Multi-classification convolutional neural network model for classification of COVID-19, pneumonia, and lung cancer from chest radiographs10.1007/s00530-021-00878-3 ↗
16. Semantic image segmentation algorithm in a deep learning computer network10.1007/s00530-020-00678-1 ↗
17. Novel electronic health records applied for prediction of pre-eclampsia: Machine-learning algorithms10.1016/j.preghy.2021.10.006 ↗
18. Conv-ViT: A convolution and vision transformer-based hybrid feature extraction method for retinal disease detection10.3390/jimaging9070140 ↗
19. An efficient and robust phonocardiography (PCG)-based valvular heart diseases (VHD) detection framework using vision transformer (VIT)10.1016/j.compbiomed.2023.106734 ↗
20. An efficient multi-scale CNN model with intrinsic feature integration for motor imagery EEG subject classification in brain-machine interfaces10.1016/j.bspc.2022.103496 ↗
21. Hybrid CNN-SVM classifier for handwritten digit recognition10.1016/j.procs.2020.03.309 ↗
22. Going deeper with convolutions
23. Multi-label multimodal emotion recognition with transformer-based fusion and emotion-level representation learning10.1109/ACCESS.2023.3244390 ↗
24. TransBTS: Multimodal brain tumor segmentation using transformer
25. Multiscale vision transformers
26. A. P. Parikh, O. Täckström, D. Das, and J. Uszkoreit, “A decomposable attention model for natural language inference,” arXiv preprint arXiv:1606.01933, 2016.10.18653/v1/D16-1244 ↗
27. Z. Lin et al., “A structured self-attentive sentence embedding,” arXiv preprint arXiv:1703.03130, 2017.
28. J. Li, Z. Tu, B. Yang, M. R. Lyu, and T. Zhang, “Multi-head attention with disagreement regularization,” arXiv preprint arXiv:1810.10183, 2018.10.18653/v1/D18-1317 ↗
29. Improving transformers with probabilistic attention keys
30. Detecting affect states using VGG16, ResNet50 and SE-ResNet50 networks10.1007/s42979-020-0114-9 ↗
31. ViT-r50 GAN: Vision transformers hybrid model based generative adversarial networks for image generation
32. Activity recognition for indoor fall detection using convolutional neural network
33. Deep learning-based human body posture recognition and tracking for unmanned aerial vehicles10.3390/pr10112295 ↗
34. Deep residual learning for image recognition
35. Vision Transformers (ViT) for blanket-penetrating sleep posture recognition using a triple ultra-wideband (UWB) radar system10.3390/s23052475 ↗
36. Depth-based hand gesture recognition using convolutional neural networks
37. A deep neural network for real-time detection of falling humans in naturally occurring scenes10.1016/j.neucom.2017.02.082 ↗
38. Non-invasive technique for real-time myocardial infarction detection using faster R-CNN10.1007/s11042-021-10957-2 ↗
39. TransCNN: Hybrid CNN and transformer mechanism for surveillance anomaly detection10.1016/j.engappai.2023.106173 ↗
40. Inception convolutional vision transformers for plant disease identification10.1016/j.iot.2022.100650 ↗
41. Vision transformer outperforms deep convolutional neural network-based model in classifying X-ray images10.1016/j.procs.2023.01.209 ↗
42. Malaria cell-image classification using inceptionV3 and SVM
43. Diabetic eye disease in computerised tomography of feature extraction and classification in hybrid neural network
44. Hybrid models for breast cancer detection via transfer learning technique
45. EEG Emotion recognition using an attention mechanism based on an optimized hybrid model
46. A hybrid posture detection framework: Integrating machine learning and deep neural networks10.1109/JSEN.2021.3055898 ↗