Process Gains, Difficulty Restructuring, and Dependency Risks in AI-Assisted Hardware-Driven Design Education: A Crossover Experimental Study
Source abstract
Abstract
Generative artificial intelligence (AI) has demonstrated significant potential in education, yet empirical research on its application in “hardware-driven” interdisciplinary design courses remains scarce. This study employed a randomized crossover experimental design in an IoT Hardware and Design Innovation course at Hunan University. Twelve industrial design undergraduates with no prior IoT background alternated between AI-assisted (ChatGPT-4o) and traditional learning resource conditions across six short-cycle tasks. The crossover design enabled each participant to serve as both experimental and control subjects, yielding 72 observation-level data points. Grounded in Cognitive Load Theory, the study examined three dimensions: process efficacy, difficulty structure, and switching adaptation costs. Results indicated that AI significantly improved perceived task completion efficiency, self-reported goal attainment, and learning experience, yet self-assessed knowledge transfer did not differ significantly between conditions. AI reduced the total number of reported difficulties but altered the difficulty-type distribution: resource-retrieval difficulties decreased while information-verification difficulties increased—a phenomenon we term “difficulty restructuring”. Furthermore, switching from AI back to traditional resources incurred significantly higher adaptation costs than the reverse transition, revealing emerging dependency risks. These findings suggest that generative AI may function more as a “difficulty restructurer” than a “difficulty eliminator” in hardware-driven design education, providing exploratory empirical evidence for incorporating verification literacy into future course design and calling for calibrated scaffold fading that may help mitigate emerging dependency risks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Artificial Intelligence in Healthcare and Education · Teaching and Learning Programming · Ethics and Social Impacts of AI
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Design, Hunan University, Changsha 410082, China
References (63)
Show source-provided references
1. Ito, J. (2026, March 24). Antidisciplinary. Joi Ito’s Web. Available online: https://joi.ito.com/weblog/2014/10/02/antidisciplinar.html.10.31859/20141002.1939 ↗
2. Changing Design Education for the 21st Century
3. How Electronics Knowledge Relates to Industrial Design Education
4. Why Some Material Is Difficult to Learn10.1207/s1532690xci1203_1 ↗
5. Decision-Guided Chatbots and Cognitive Styles in Interdisciplinary Learning10.1016/j.compedu.2023.104812 ↗
6. Ge, P., and Fan, F. (2024). A Systematic Review of the Role of Artificial Intelligence in Design Education. Proceedings of the 26th International Conference on Engineering and Product Design Education (E&PDE 2024), Birmingham, UK, 5–6 September 2024, The Design Society.10.35199/EPDE.2024.18 ↗
7. Designing for Systems of Smart Things
8. Posthumanism and Design
9. O’Sullivan, D., and Igoe, T. (2004). Physical Computing: Sensing and Controlling the Physical World with Computers, Course Technology Press.
10. Physical Computing and Its Scope—Towards a Constructionist Computer Science Curriculum with Physical Computing10.15388/infedu.2014.14 ↗
11. Technology-Driven Design Process: Teaching and Mentoring Technology-Driven Design Process in Industrial Design Education10.1007/s10798-022-09739-0 ↗
12. ChatGPT: The Cognitive Effects on Learning and Memory10.1002/brx2.30 ↗
13. ChatGPT Effects on Cognitive Skills of Undergraduate Students: Receiving Instant Responses from AI-Based Conversational Large Language Models (LLMs)10.1016/j.caeai.2023.100198 ↗
14. Role of AI Chatbots in Education: Systematic Literature Review10.1186/s41239-023-00426-1 ↗
15. Artificial Intelligence Applications in K-12 Education: A Systematic Literature Review10.1109/ACCESS.2022.3179356 ↗
16. ChatGPT Early Usage among Students: A Global Evidence of Determinants10.1016/j.dsef.2025.100065 ↗
17. Tien, Y.-T., and Chen, R. (2024). Challenges of Artificial Intelligence in Design Education. Proceedings of the 2024 15th International Conference on E-Education, E-Business, E-Management and E-Learning (IC4E 2024), Fukuoka, Japan, 18–21 March 2024, ACM.10.1145/3670013.3670044 ↗
18. AcademAI: Investigating AI Usage, Attitudes, and Literacy in Higher Education and Research10.1177/00472395251347304 ↗
19. The Impact of Gen AI on Art and Design Program Education
20. Generative Artificial Intelligence Tools for Diverse Learning Styles in Design Education
21. AI Chatbots in Programming Education: Students’ Use in a Scientific Computing Course and Consequences for Learning10.1016/j.caeai.2024.100290 ↗
22. Integrating AI-Generated Content Tools in Higher Education: A Comparative Analysis of Interdisciplinary Learning Outcomes10.1038/s41598-025-10941-y ↗
23. Internet of Things: Architectures, Protocols, and Applications
24. Internet of Things in Higher Education: A Study on Future Learning10.1088/1742-6596/892/1/012017 ↗
25. Amador Nelke, S., Kohen-Vacs, D., Khomyakov, M., Rosienkiewicz, M., Helman, J., Cholewa, M., Molasy, M., Górecka, A., Gómez-González, J.-F., and Bourgain, M. (2024). Enhancing Lessons on the Internet of Things in Science, Technology, Engineering, and Medical Education with a Remote Lab. Sensors, 24.10.3390/s24196424 ↗
26. Educational Framework for IoT Product and Service Prototyping
27. Heinis, T., Gomes Martinho, C., and Meboldt, M. (2017). Fundamental Challenges in Developing Internet of Things Applications for Engineers and Product Designers. Proceedings of the 21st International Conference on Engineering Design (ICED 17), Vol. 5: Design for X, Design to X, Vancouver, BC, Canada, 21–25 August 2017, The Design Society.
28. Conquering Coding Fears: A Systematic Review of Programming Anxiety in Higher Education
29. Factors Contributing to Dropping out of Adults’ Programming e-Learning10.1016/j.heliyon.2023.e22113 ↗
30. The Role of Tutoring in Problem Solving10.1111/j.1469-7610.1976.tb00381.x ↗
31. ChatGPT and Other Large Language Models Are Double-edged Swords10.1148/radiol.230163 ↗
32. Chatbot Confabulations Are Not Hallucinations10.1001/jamainternmed.2023.4231 ↗
33. Large Language Models in Medical Education: Opportunities, Challenges, and Future Directions10.2196/48291 ↗
34. Epistemically Violent Biases in Artificial Intelligence Design: The Case of DALLE-E 2 and Starry AI10.1108/DTS-01-2023-0003 ↗
35. Rising Adoption of Artificial Intelligence in Scientific Publishing: Evaluating the Role, Risks, and Ethical Implications in Paper Drafting and Review Process10.1515/cclm-2023-1136 ↗
36. Holy or Unholy? Interview with Open AI’s ChatGPT10.54055/ejtr.v34i.3169 ↗
37. Li, J., Cao, H., Lin, L., Hou, Y., Zhu, R., and El Ali, A. (2024). User Experience Design Professionals’ Perceptions of Generative Artificial Intelligence. Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI ‘24), Honolulu, HI, USA, 11–16 May 2024, ACM.10.1145/3613904.3642114 ↗
38. Integration of Generative Artificial Intelligence in Design Education: Evidence Review (2020–2024)
39. ChatGPT as a Cognitive Crutch: Evidence from a Randomized Controlled Trial on Knowledge Retention
40. Chatting and Cheating: Ensuring Academic Integrity in the Era of ChatGPT10.1080/14703297.2023.2190148 ↗
41. De Angelis, L., Baglivo, F., Arzilli, G., Privitera, G.P., Ferragina, P., Tozzi, A.E., and Rizzo, C. (2023). ChatGPT and the Rise of Large Language Models: The New AI-Driven Infodemic Threat in Public Health. Front. Public Health, 11.10.3389/fpubh.2023.1166120 ↗
42. Sagar, P. (2024). Exploring the Use of ChatGPT and the Prompting Framework as a Self-Learning Aid for Arduino Coding & Circuit Building for Artists and Designers. [Master’s Thesis, Massachusetts Institute of Technology]. Available online: https://dspace.mit.edu/handle/1721.1/154011.
43. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology10.2307/249008 ↗
44. Pintrich, P.R., Smith, D.A.F., Garcia, T., and McKeachie, W.J. (2026, March 27). A Manual for the Use of the Motivated Strategies for Learning Questionnaire (MSLQ), Available online: https://files.eric.ed.gov/fulltext/ED338122.pdf.
45. Keller, J.M. (2010). Motivational Design for Learning and Performance: The ARCS Model Approach, Springer.10.1007/978-1-4419-1250-3 ↗
46. Cognitive Architecture and Instructional Design10.1023/A:1022193728205 ↗
47. Senn, S.S. (2002). Cross-Over Trials in Clinical Research, John Wiley & Sons. [2nd ed.].10.1002/0470854596 ↗
48. Kazemitabaar, M., Chow, J., Ma, C.K.T., Ericson, B.J., Weintrop, D., and Grossman, T. (2023). Studying the Effect of AI Code Generators on Supporting Novice Learners in Introductory Programming. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ‘23), Hamburg, Germany, 23–28 April 2023, ACM.10.1145/3544548.3580919 ↗
49. Bravo, F.A., and Cruz-Bohorquez, J.M. (2024). Engineering Education in the Age of AI: Analysis of the Impact of Chatbots on Learning in Engineering. Educ. Sci., 14.10.3390/educsci14050484 ↗
50. Generative AI without Guardrails Can Harm Learning: Evidence from High School Mathematics10.1073/pnas.2422633122 ↗
51. The Effect of ChatGPT on Students’ Learning Performance, Learning Perception, and Higher-Order Thinking: Insights from a Meta-Analysis10.1057/s41599-025-04787-y ↗
52. Cognitive Ease at a Cost: LLMs Reduce Mental Effort but Compromise Depth in Student Scientific Inquiry10.1016/j.chb.2024.108386 ↗
53. Cognitive Load Theory and Its Relationships with Motivation: A Self-Determination Theory Perspective10.1007/s10648-023-09841-2 ↗
54. The Effects of Over-Reliance on AI Dialogue Systems on Students’ Cognitive Abilities: A Systematic Review10.1186/s40561-024-00316-7 ↗
55. Exploring the Boundaries of Reality: Investigating the Phenomenon of Artificial Intelligence Hallucination in Scientific Writing through ChatGPT References
56. GenAI and Misinformation in Education: A Systematic Scoping Review of Opportunities and Challenges10.1007/s00146-025-02536-y ↗
57. Emerging Trends: When Can Users Trust GPT, and When Should They Intervene?10.1017/S1351324923000578 ↗
58. Ironies of Automation10.1016/0005-1098(83)90046-8 ↗
59. Scaffolding in Teacher–Student Interaction: A Decade of Research10.1007/s10648-010-9127-6 ↗
60. Bronfenbrenner, U. (1979). The Ecology of Human Development: Experiments by Nature and Design, Harvard University Press.10.4159/9780674028845 ↗
61. van Lier, L. (2004). The Ecology and Semiotics of Language Learning: A Sociocultural Perspective, Kluwer Academic Publishers.10.1007/1-4020-7912-5 ↗
62. A strategic framework for responsible GenAI adoption: Balancing sustainability and institutional risks in academic libraries10.1016/j.acalib.2026.103218 ↗
63. Practical Considerations for Adopting Generative AI Tools in Academic Libraries10.1080/01930826.2025.2506151 ↗