Designing Pedagogically Effective Haptic Systems for Learning: A Review
Source abstract
Abstract
Haptic technology enables users to utilize their sense of touch while engaging with a virtual representation of objects in a simulated environment. It is a bidirectional technology in that it facilitates the interaction between the user and these virtual representations by allowing them to apply force onto one another, which is analogous to our real-world interactions with physical objects as action-reaction pairs. The sense of touch is a powerful and innate learning tool that we readily employ starting from very early ages as infants even before learning to walk. Therefore, it is natural that incorporating haptic technology into pedagogical methods has been an active research area as it has significant potential to enrich the learning experience and provide an engaging environment for learners. In this paper, we reviewed studies from various disciplines that incorporate haptics to increase the quality of teaching and learning while emphasizing the underlying cognitive theories. In that direction, we describe two of the most common cognitive theories, the Cognitive Load and Embodied Cognition theories, that developers use to support haptic technology’s implications and use in learning environments. We then explore the effects of haptic design on its current applicability following these two theories. Finally, we summarize the best design practices to develop haptic simulations for learning, address gaps in current research, and propose new research directions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Visual and Cognitive Learning Processes · Teleoperation and Haptic Systems · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Pharmacology, University of Michigan, Ann Arbor, MI 48109, USA
Robotics and Haptics Lab, School of Engineering and Technology, Central Michigan University, Mount Pleasant, MI 48859, USA
References (63)
Show source-provided references
1. Haptics—Touch feedback Technology Widening the Horizon of Medicine
2. Haptics in Education: Exploring an Untapped Sensory Modality10.3102/00346543076003317 ↗
3. Zara Stone (2019, September 09). Controllers Bring Real Pain to VR Games. Available online: https://www.wired.com/story/haptic-controllers-for-vr-bring-real-pain-to-games/.
4. Incorporating haptic feedback in simulation for learning physics
5. Embodied Learning using a tangible user interface: The effects of haptic perception and selective pointing on a spatial learning task
6. Haptic explorers: Supporting science journaling through mobile haptic feedback displays10.1016/j.ijhcs.2018.09.005 ↗
7. Haptics-Augmented Simple-Machine Educational Tools10.1023/A:1022114409119 ↗
8. Tangibles for learning: A representational analysis of physical manipulation10.1007/s00779-011-0406-0 ↗
9. Hayes, J.C., and Kraemer, D.J. (2017). Grounded understanding of abstract concepts: The case of STEM learning. Cogn. Res. Princ. Implic., 2.10.1186/s41235-016-0046-z ↗
10. Han, I.S. (2010). Feel, Imagine and Learn!—Haptic Augmented Simulation and Embodied Instruction in Physics Learning, Teachers College, Columbia University: ProQuest LLC.
11. An Evolutionary Upgrade of Cognitive Load Theory: Using the Human Motor System and Collaboration to Support the Learning of Complex Cognitive Tasks10.1007/s10648-011-9179-2 ↗
12. Six Views of Embodied Cognition10.3758/BF03196322 ↗
13. Measuring Cognitive Load in Embodied Learning Settings10.3389/fpsyg.2017.01191 ↗
14. Pupillary response to complex interdependent tasks: A cognitive-load theory perspective10.3758/s13428-016-0833-y ↗
15. Cognitive load theory, educational research, and instructional design: Some food for thought10.1007/s11251-009-9110-0 ↗
16. Action-based language: A theory of language acquisition, comprehension, and production10.1016/j.cortex.2011.04.010 ↗
17. Weisberg, S.M., and Newcombe, N.S. (2017). Embodied Cognition and STEM learning: Overview of a topical collection in CR: PI. Cogn. Res. Princ. Implic.10.1186/s41235-017-0071-6 ↗
18. Physical experience enhances science learning10.1177/0956797615569355 ↗
19. Haptic Augmentation of Science Instruction: Does Touch Matter?
20. Learning at the Nanoscale: The Impact of Students’ Use of Remote Microscopy of Concepts of Viruses, Scale, and Microscopy
21. Exploring relationships between students’ interaction and learning with a haptic virtual biomolecular model10.1016/j.compedu.2011.05.013 ↗
22. Grounded and embodied mathematical cognition: Promoting mathematical insight and proof using action and language10.1186/s41235-016-0040-5 ↗
23. How design features in digital math games support learning and mathematics connections10.1016/j.chb.2018.09.036 ↗
24. Davis, R., Martinez, M., Schneider, O., MacLean, K., Okamrua, A., and Blikstein, P. (2017). The Haptic Bridge: Towards a Theory for Haptic-Supported Learning, Association for Computing Machinery.10.1145/3078072.3079755 ↗
25. Yiannoutsou, N., Johnson, R., and Price, S. (2018). Exploring How Children Interact with 3D Shapes Using Haptic Technologies, Association for Computing Machinery.10.1145/3202185.3210771 ↗
26. McWilliams and Malecha (2017). Comparing Intravenous Insertion Instructional Methods with Haptic Simulators. Nurs. Res. Pract., 2017, 4685157.10.1155/2017/4685157 ↗
27. Role of Haptic Feedback and Cognitive Load in Surgical Skill Acquisition
28. Surgical simulation: A current review10.1007/s00464-006-9072-0 ↗
29. Somatosensory working memory in human reinforcement-based motor learning10.1152/jn.00442.2018 ↗
30. Haptic modules for palpatory diagnosis training of medical students10.1007/s10055-013-0220-2 ↗
31. A review of simulators with haptic devices for medical training
32. Efficiency of palpation in clinical detection of breast cancer
33. Using visual cues to enhance haptic feedback for palpation on virtual model of soft tissue10.1007/s11517-015-1309-4 ↗
34. Haptic Feedback, Force Feedback, and Force-Sensing in Simulation Training for Laparoscopy: A Systematic Overview10.1016/j.jsurg.2018.06.008 ↗
35. Van der Putten Westebring, E.P. (2011, January 24). A Sense of Touch in Laparoscopy: Using Augmented Haptic Feedback to Improve Grasp Control. Available online: http://resolver.tudelft.nl/uuid:beebbcde-0129-4e10-94b3-241609069445.
36. Lack of transfer of skills after virtual reality simulator training with haptic feedback10.1080/13645706.2017.1319866 ↗
37. Early exposure to haptic feedback enhances performance in surgical simulator training: A prospective randomized crossover study in surgical residents
38. Teaching Bovine Abdominal Anatomy: Use of a Haptic Simulator10.1002/ase.109 ↗
39. A Mixed Reality Simulator for Feline Abdominal Palpation Training in Veterinary Medicine. 2009
40. A user-centered design and analysis of an electrostatic haptic touchscreen system for students with visual impairments10.1016/j.ijhcs.2017.09.004 ↗
41. Computer haptics: A new way of increasing access and understanding of math and science for students who are blind and visually impaired
42. Bussell, L. (2020, February 07). Touch Tiles: Elementary Geometry Software with a Haptic and Auditory Interface for Visually Impaired Children. Available online: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.3.4699&rep=rep1&type=pdf.
43. Avila-Soto, M., Bahamondez, E., and Schmidt, A. (2017). TanMath: A Tangible Math Application to Support Children with Visual Impairment to Learn Basic Arithmetic, Association for Computing Machinery.10.1145/3056540.3064964 ↗
44. Haptics-based apps for middle school students with visual impairments10.1109/TOH.2015.2401832 ↗
45. Fernandes, L. (2014, July 31). The Abacus: A Brief History. Available online: https://www.ee.ryerson.ca/~elf/abacus/history.html.
46. Development of navigation skills through audio haptic videogaming in learners who are blind10.1016/j.procs.2012.10.012 ↗
47. Sjostrom, C. (2001). Using Haptics in Computer Interfaces for Blind People, Association for Computing Machinery.10.1145/634067.634213 ↗
48. Designing Innovative Science Assessments That Are Accessible for Students Who Are Blind
49. Roessingh and Bence (2018). Embodied Cognition: Laying the Foundation for Early Language and Literacy Learning. Lang. Lit., 20, 23–39.10.20360/langandlit29435 ↗
50. Haptics in learning to read with children from low socio-economic status families10.1348/026151007X186643 ↗
51. Jiao, Y., Severgnini, F., Martinez, J., Jung, J., Tan, H., Reed, C., Wilson, E., Lau, F., Israr, A., and Turcott, R. (2018). A Comparative Study of Phoneme- and Word-Based Learning of English Words Presented to the Skin, Springer.10.1007/978-3-319-93399-3_53 ↗
52. Dunkelberger, N., Bradley, J., Sullivan, J., Israr, A., Lau, F., Klumb, K., Abnousi, F., and O’Malley, M. (2018). Improving Perception Accuracy with Multi-Sensory Haptic Cue Delivery, Springer.10.1007/978-3-319-93399-3_26 ↗
53. Palluel-Germain, R., Bara, F., Boisferon, A., Hennion, B., Gouagout, P., and Gentaz, E. (2007, January 22–24). A visuo-haptic device-telemaque-increases kindergarten children’s handwriting acquisition. Proceedings of the Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC’07), Tsukuba, Japan.10.1109/WHC.2007.13 ↗
54. Combining Full and Partial Haptic Guidance Improves Handwriting Skills Development10.1109/TOH.2018.2851511 ↗
55. Comparing Haptic and Visual Training Method of Learning Chinese Handwriting with a Haptic Guidance
56. Kim, Y.S., Collins, M., Bulmer, W., Sharma, S., and Mayrose, J. (2013, January 14–17). Haptics Assisted Training (HAT) System for Children’s Handwriting. Proceedings of the IEEE World Haptics Conference (WHC’13), Daejeon, Korea.
57. Ogawa, D., Ikeno, S., Okazaki, R., Hachisu, T., and Kajimoto, H. (2014). Tactile Cue Presentation for Vocabulary Learning with Keyboard, Association for Computing Machinery.10.1145/2658779.2658782 ↗
58. Kasahara, S., Takada, K., Nishida, J., Shibata, K., Shimojo, S., and Lopes, P. (2021). Preserving Agency during Electrical Muscle Stimulation Training Speeds up Reaction Time Directly after Removing EMS, Association for Computing Machinery.10.1145/3411764.3445147 ↗
59. Erp, J., Saturday, I., and Jansens, C. (2021, July 06). Application of Tactile Displays in Sports: Where to, How and When to Move. Available online: https://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.505.5924&rep=rep1&type=pdf.
60. Nine Ways to Reduce Cognitive Load in Multimedia Learning10.1207/S15326985EP3801_6 ↗
61. Impairing somatosensory working memory using rTMS10.1111/j.1460-9568.2011.07797.x ↗
62. Ayelet, S. (2011). Do Gestural Interfaces Promote Thinking? Embodied Interaction: Congruent Gestures and Direct-Touch Promote Performance in Math. [Ph.D. Thesis, Columbia University].
63. Blending Physical and Virtual Manipulatives: An Effort to Improve Students’ Conceptual Understanding Through Science Laboratory Experimentation