Real Objects Understanding Using 3D Haptic Virtual Reality for E-Learning Education
Source abstract
Abstract
In the past two decades, there has been a lot of work on computer vision technology that incorporates many tasks which implement basic filtering to image classification. The major research areas of this field include object detection and object recognition. Moreover, wireless communication technologies are presently adopted and they have impacted the way of education that has been changed. There are different phases of changes in the traditional system. Perception of three-dimensional (3D) from two-dimensional (2D) image is one of the demanding tasks. Because human can easily perceive but making 3D using software will take time manually. Firstly, the blackboard has been replaced by projectors and other digital screens so such that people can understand the concept better through visualization. Secondly, the computer labs in schools are now more common than ever. Thirdly, online classes have become a reality. However, transferring to online education or e-learning is not without challenges. Therefore, we propose a method for improving the efficiency of e-learning. Our proposed system consists of two-and-a-half dimensional (2.5D) features extraction using machine learning and image processing. Then, these features are utilized to generate 3D mesh using ellipsoidal deformation method. After that, 3D bounding box estimation is applied. Our results show that there is a need to move to 3D virtual reality (VR) with haptic sensors in the field of e-learning for a better understanding of real-world objects. Thus, people will have more information as compared to the traditional or simple online education tools. We compare our result with the ShapeNet dataset to check the accuracy of our proposed method. Our proposed system achieved an accuracy of 90.77% on plane class, 85.72% on chair class, and car class have 72.14%. Mean accuracy of our method is 70.89%.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Augmented Reality Applications · Teleoperation and Haptic Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (84)
Show source-provided references
1. Immersive and haptic educational simulations of assembly workplace conditions10.1016/j.procs.2015.12.258 ↗
2. Virtual reality for collaborative e-learning10.1016/j.compedu.2006.12.008 ↗
3. A new virtual reality environment used for e-learning
4. RGB-D images for objects recognition using 3D point clouds and RANSAC plane fitting
5. Region and decision tree-based segmentations for multi-objects detection and classification in outdoor scenes
6. The evolution of e-learning in the context of 3D virtual worlds
7. Image-based 3d object reconstruction: State-of-the-art and trends in the deep learning era10.1109/TPAMI.2019.2954885 ↗
8. Deep neural networks for object detection
9. Three-filters-to-normal: An accurate and ultrafast surface normal estimator10.1109/LRA.2021.3067308 ↗
10. Depth and surface normal estimation from monocular images using regression on deep features and hierarchical CRFs
11. Make3D: Depth perception from a single still image
12. Hierarchical surface prediction for 3D object reconstruction
13. Human body parts estimation and detection for physical sports movements
14. Salient segmentation based object detection and recognition using hybrid genetic transform
15. Augmented virtual reality: How to improve education systems10.18870/hlrc.v7i1.373 ↗
16. Effective e-learning using 3D virtual tutors and webrtc based multimedia chat
17. Haptic enabled collaborative learning in virtual reality for schools10.1007/s10639-021-10639-4 ↗
18. Haptic virtual reality and immersive learning for enhanced organic chemistry instruction10.1007/s10055-018-0345-4 ↗
19. Exploring relationships between students’ interaction and learning with a haptic virtual biomolecular model10.1016/j.compedu.2011.05.013 ↗
20. Multi-features descriptors for human activity tracking and recognition in indoor-outdoor environments
21. Wearable sensor-based human behavior understanding and recognition in daily life for smart environments
22. Robust spatio-temporal features for human interaction recognition via artificial neural network
23. A triaxial acceleration-based human motion detection for ambient smart home system
24. Development of a life logging system via depth imaging-based human activity recognition for smart homes
25. Human activity recognition using the labeled depth body parts information of depth silhouettes
26. Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home10.1109/TCE.2012.6311329 ↗
27. Ridge body parts features for human pose estimation and recognition from RGB-D video data
28. Automatic recognition of human interaction via hybrid descriptors and maximum entropy markov model using depth sensors10.3390/e22080817 ↗
29. Dense depth maps-based human pose tracking and recognition in dynamic scenes using ridge data
30. Real-time life logging via a depth silhouette-based human activity recognition system for smart home services
31. Human daily activity recognition with joints plus body features representation using kinect sensor
32. A spatiotemporal motion variation features extraction approach for human tracking and pose-based action recognition
33. A hybrid feature extraction approach for human detection, tracking and activity recognition using depth sensors10.1007/s13369-015-1955-8 ↗
34. Robust human activity recognition from depth video using spatiotemporal multi-fused features10.1016/j.patcog.2016.08.003 ↗
35. Depth images-based human detection, tracking and activity recognition using spatiotemporal features and modified HMM10.5370/JEET.2016.11.6.1857 ↗
36. Facial expression recognition using 1D transform features and hidden Markov model
37. A depth video-based human detection and activity recognition using multi-features and embedded hidden Markov models for health care monitoring systems10.9781/ijimai.2017.447 ↗
38. Wearable sensors based human behavioral pattern recognition using statistical features and reweighted genetic algorithm10.1007/s11042-019-08463-7 ↗
39. Human actions tracking and recognition based on body parts detection via artificial neural network
40. Wearable sensors for activity analysis using smo-based random forest over smart home and sports datasets
41. Human activity recognition via recognized body parts of human depth silhouettes for residents monitoring services at smart home10.1177/1420326X12469714 ↗
42. SOSD-Net: Joint semantic object segmentation and depth estimation from monocular images10.1016/j.neucom.2021.01.126 ↗
43. YOLO-LITE: A real-time object detection algorithm optimized for non-gpu computers
44. Recent advances in deep learning for object detection10.1016/j.neucom.2020.01.085 ↗
45. Robust real-time object detection
46. An HOG-LBP human detector with partial occlusion handling
47. Human activity recognition via the features of labeled depth body parts
48. A wrist worn acceleration based human motion analysis and classification for ambient smart home system10.1007/s42835-019-00187-w ↗
49. Region and decision tree-based segmentations for multi-objects detection and classification in outdoor scenes
50. WHITE STAG model: Wise human interaction tracking and estimation (WHITE) using spatio-temporal and angular-geometric (STAG) descriptors10.1007/s11042-019-08527-8 ↗
51. A novel statistical method for scene classification based on multi-object categorization and logistic regression
52. Human posture estimation and sustainable events classification via pseudo-2d stick model and k-ary tree hashing
53. Syntactic model-based human body 3d reconstruction and event classification via association based features mining and deep learning10.7717/peerj-cs.764 ↗
54. Kim “Scene semantic recognition based on modified fuzzy c-mean and maximum entropy using object-to-object relations”10.1109/ACCESS.2021.3058986 ↗
55. Semantic recognition of human-object interactions via Gaussian-based elliptical modelling and pixel-level labeling10.1109/ACCESS.2021.3101716 ↗
56. Statistical multi-objects segmentation for indoor/outdoor scene detection and classification via depth images
57. Automated sustainable multi-object segmentation and recognition via modified sampling consensus and kernel sliding perceptron10.3390/sym12111928 ↗
58. Modeling two-person segmentation and locomotion for stereoscopic action identification: A sustainable video surveillance system
59. Multi-objects detection and segmentation for scene understanding based on texton forest and kernel sliding perceptron
60. A computational theory of human stereo vision
61. Squeeze-and-excitation networks
62. Scannet: Richly-annotated 3d reconstructions of indoor scenes
63. Designing deep networks for surface normal estimation
64. Deep mesh reconstruction from single RGB images via topology modification networks
65. Deep residual learning for image recognition
66. Students' behavior mining in E-learning environment using cognitive processes with information technologies10.1007/s10639-019-09892-5 ↗
67. Stochastic remote sensing event classification over adaptive posture estimation via multifused data and deep belief network10.3390/rs13050912 ↗
68. Automatic human posture estimation for sport activity recognition with robust body parts detection and entropy markov model10.1007/s11042-021-10687-5 ↗
69. Adaptive pose estimation for gait event detection using context-aware model and hierarchical optimization10.1007/s42835-021-00756-y ↗
70. Monitoring real-time personal locomotion behaviors over smart indoor-outdoor environments via body-worn sensors10.1109/ACCESS.2021.3078513 ↗
71. A smart surveillance system for people counting and tracking using particle flow and modified SOM
72. A systematic deep learning based overhead tracking and counting system using RGB-d remote cameras10.3390/app11125503 ↗
73. Smartphone inertial sensors for human locomotion activity recognition based on template matching and codebook generation
74. An accurate facial expression detector using multi-landmarks selection and local transform features
75. Hybrid algorithm for multi people counting and tracking for smart surveillance
76. HF-SPHR: Hybrid features for sustainable physical healthcare pattern recognition using deep belief networks
77. Hand gesture recognition based on auto-landmark localization and reweighted genetic algorithm for healthcare muscle activities
78. 3D bounding box estimation using deep learning and geometry
79. Chang · ShapeNet: An Information-Rich 3d Model Repository · 2015 · 1
80. Neural 3d mesh renderer
81. The moderating effect of demographic factors acceptance virtual reality learning in developing countries in the Middle East
82. Employing lexicalized dependency paths based supervised learning for relation extraction10.32604/csse.2022.030759 ↗
83. Hybrid user evaluation methodology for remote evaluation: Case study of educational games for children during covid-19 pandemic
84. Perceived security risk based on moderating factors for blockchain technology applications in cloud storage to achieve secure healthcare systems10.1155/2022/6112815 ↗