journal article·2025-02-27Open access

Automatic Correction System for Learning Activities in Remote-Access Laboratories in the Mechatronics Area

Guido S. Machado, Thiago R. M. Salgado, Florindo A. C. Ayres, Iury V. Bessa, Renan L. P. Medeiros, Vicente F. Lucena

Applied Sciences· Volume 15· Issue 5

Abstract

In recent years, the educational field has evolved rapidly owing to the integration of several technologies, especially experiments in remote laboratories in the engineering area. Therefore, this article addresses the development of an innovation system for automatically correcting experiments in remote laboratories in mechatronics using digital twins, convolutional neural networks (CNNs), and generative artificial intelligence technologies. This system was designed to overcome the limitations of physical laboratories and teacher’s availability and assist in learning, enabling automatic acquisitions at any time. The digital twin captures data from the teacher’s and student’s experiments, allowing accurate comparisons to identify successes and errors. The application of CNNs serves to validate the results of the experiments through image analysis, whereas generative AI helps to identify patterns. The system was evaluated in a didactic plant, effectively correcting experiments with digital inputs and outputs. In addition, it provides students with detailed feedback on their performance, including specific errors and suggestions for improvement. With a three-layer architecture, i.e., experiments, didactics, and management, the system efficiently processes data from teachers and students, contributing to correcting experiments and optimizing teaching in remote environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Experimental Learning in Engineering · Mechatronics Education and Applications · Engineering Education and Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Faculty of Technology, Project Super—CETELI—UFAM, Manaus 69080900, Brazil

Faculty of Technology, PPGEE/UFAM—Postgraduate Program in Electrical Engineering, Federal University of Amazonas in Manaus, Manaus 69080900, Brazil

PIC—Product Innovation Center, FIT—Flex Institute Technology, Manaus 69093415, Brazil

Funding

National Council for Scientific and Technological Development (CNPq) · Federal Agency for Support and Evaluation of Graduate Education (CAPES) · FAPEAM (Fundação de Amparo à Pesquisa do Estado do Amazonas) · Samsung Electronics of Amazonia Ltd.a.

References (66)

Show source-provided references
1. Computer-Aided Experiments (CAE): A Study Regarding a Remote-Controlled Experiment, Video Analysis, and Simulation on Kinematics10.1109/TE.2023.3349092 ↗
2. Young, V., Cho, S., Talley, C., Voicu, R.C., Tekes, C., and Tekes, A. (2024, January 15–24). A Modular Control Lab Equipment and Virtual Simulations for Engineering Education. Proceedings of the SoutheastCon 2024, Atlanta, GA, USA.10.1109/SoutheastCon52093.2024.10500097 ↗
3. Robotics Labs and Other Hands-On Teaching During COVID-19: Change Is Here to Stay?10.1109/MRA.2021.3102979 ↗
4. Martínez, R.J.D. (2023, January 16–18). Design Experience of Laboratory Practices in COVID Times. Proceedings of the 2023 Future of Educational Innovation-Workshop Series Data in Action, Monterrey, Mexico.10.1109/IEEECONF56852.2023.10104592 ↗
5. Kunzhe, L., and Kholodilin, I. (2023, January 23–25). Developing Virtual Laboratories for Understanding the Automation Course. Proceedings of the 2023 Seminar on Electrical Engineering, Automation & Control Systems, Theory and Practical Applications (EEACS), Saint Petersburg, Russia.10.1109/EEACS60421.2023.10397226 ↗
6. Open Remote Web Lab for Learning Robotics and ROS With Physical and Simulated Robots in an Authentic Developer Environment10.1109/TLT.2024.3381858 ↗
7. An Assessment of Remote Laboratory Experiments in Radio Communication10.1109/TE.2013.2262685 ↗
8. Jazdi, N., Gohner, P., Brito, A., and de Lucena, V.F. (2006, January 19–21). A Germany-Brazil Experience Report on Teaching Software Engineering for Electrical Engineering Undergraduate Students. Proceedings of the 19th Conference on Software Engineering Education & Training (CSEET’06), Turtle Bay, HI, USA.
9. Ferreira de Lucena, V., de Queiroz-Neto, J.P., Benchimol, I.B., Pereira Mendonca, A., Romao da Silva, V., and Ferreira Filho, M. (2007, January 10–13). Teaching software engineering for embedded systems: An experience report from the manaus research and development pole. Proceedings of the 2007 37th Annual Frontiers in Education Conference—Global Engineering: Knowledge Without Borders, Opportunities Without Passports, Milwaukee, WI, USA.10.1109/FIE.2007.4417966 ↗
10. Fernandez, G.C., Borrego, R.C., Merino, P.P., Lopez, M.A.C., Ruiz, E.S., Gil, M.C., and Perez, F.M. (2015, January 18–20). Mechatronics and Robotics as Motivational Tools in Remote Laboratories. Proceedings of the 2015 IEEE Global Engineering Education Conference (EDUCON), Tallinn, Estonia.
11. Rodriguez-Calderon, R. (2021, January 14–17). In-Home Laboratory for Learning Automation at no Cost. Proceedings of the 2021 IEEE World Conference on Engineering Education (EDUNINE), Guatemala City, Guatemala.10.1109/EDUNINE51952.2021.9429156 ↗
12. Verslype, S., Buysse, L., Peuteman, J., Pissoort, D., and Boydens, J. (2020, January 16–18). Remote laboratory setup for software verification in an embedded systems and mechatronics course. Proceedings of the 2020 XXIX International Scientific Conference Electronics (ET), Sozopol, Bulgaria.10.1109/ET50336.2020.9238151 ↗
13. Mershad, K., Damaj, A., and Hamieh, A. (2019, January 14–17). Using Internet of Things for Automatic Student Assessment during Laboratory Experiments. Proceedings of the 2019 IEEE International Smart Cities Conference (ISC2), Casablanca, Morocco.10.1109/ISC246665.2019.9071654 ↗
14. An Extensible Architecture for the Integration of Remote and Virtual Laboratories in Public Learning Tools
15. SEITI RMLab: A costless and effective remote measurement laboratory in electrical engineering10.1177/0020720918775041 ↗
16. de Vries, E., and Wortche, H. (October, January 27). Remote Labs and their Didactics in Engineering Education: A Case Study. Proceedings of the 2021 44th International Convention on Information, Communication and Electronic Technology (MIPRO), Opatija, Croatia.10.23919/MIPRO52101.2021.9597027 ↗
17. Education in I&M: New Insights in Remote Teaching and Learning of Instrumentation and Measurement: The iHomeX Remote Lab Project10.1109/MIM.2024.10423663 ↗
18. Student-Facing Learning Analytics Dashboard for Remote Lab Practical Work10.1109/TLT.2024.3354128 ↗
19. Sarac, V. (2024, January 20–22). Learning Fundamentals of Electrical Engineering by the Aid of Virtual Laboratories. Proceedings of the 2024 23rd International Symposium INFOTEH-JAHORINA (INFOTEH), East Sarajevo, Bosnia and Herzegovina.10.1109/INFOTEH60418.2024.10496024 ↗
20. Schauer, F., Krbecek, M., Beno, P., Gerza, M., Palka, L., and Spilakova, P. (2015, January 25–27). REMLABNET II—Open Remote Laboratory Management System for University and Secondary Schools Research Based Teaching. Proceedings of the 2015 12th International Conference on Remote Engineering and Virtual Instrumentation (REV), Bangkok, Thailand.10.1109/REV.2015.7087273 ↗
21. The Joint Training, a SENA Learning Model for Latin America10.1109/TLA.2016.7555287 ↗
22. AbuShanab, S., Winzker, M., Bruck, R., and Schwandt, A. (2018, January 17–20). A study of integrating remote laboratory and on-site laboratory for low-power education. Proceedings of the 2018 IEEE Global Engineering Education Conference (EDUCON), Santa Cruz de Tenerife, Spain.10.1109/EDUCON.2018.8363259 ↗
23. Enhanced Virtual Laboratory Experience for Wireless Networks Planning Learning
24. Nau, J., and Henke, K. (2024, January 10–13). GOLDi Labs as Fully Integrated Learning Environment. Proceedings of the 2024 IEEE World Engineering Education Conference (EDUNINE), Guatemala City, Guatemala.10.1109/EDUNINE60625.2024.10500662 ↗
25. ReImagine Lab: Bridging the Gap Between Hands-On, Virtual and Remote Control Engineering Laboratories Using Digital Twins and Extended Reality10.1109/ACCESS.2022.3199371 ↗
26. Extended Remote Laboratories: A Systematic Review of the Literature From 2000 to 202210.1109/ACCESS.2023.3271524 ↗
27. Ferramentas digitais, tecnologias e metodologias de aprendizagem para estruturas de educação 4.0: Uma pesquisa orientada para STEM10.1109/ACCESS.2024.3355282 ↗
28. Kuvshinnikov, V., Kovshov, E., and Korchagin, V. (2024, January 16–19). Digital Educational Resources in Industrial Radiography. Proceedings of the 2024 7th International Conference on Information Technologies in Engineering Education (Inforino), Moscow, Russia.10.1109/Inforino60363.2024.10551923 ↗
29. RFWNet: A Multiscale Remote Sensing Forest Wildfire Detection Network with Digital Twinning, Adaptive Spatial Aggregation, and Dynamic Sparse Features
30. Prohaska, S., and Kennes, L. (2023, January 2–4). Evaluating the Use of Virtual Twins in a Control Systems Course. Proceedings of the 2023 IEEE 2nd German Education Conference (GECon), Berlin, Germany.10.1109/GECon58119.2023.10295135 ↗
31. Elias-Espinosa, M.C., and Bastida-Escamilla, E. (2022, January 9–11). Evaluating Digital Twins as Training Centers: A Case Study. Proceedings of the 2022 10th International Conference on Information and Education Technology (ICIET), Matsue, Japan.10.1109/ICIET55102.2022.9778983 ↗
32. Digital Twins: A Survey on Enabling Technologies, Challenges, Trends and Future Prospects10.1109/COMST.2022.3208773 ↗
33. Digital Twin Models: Functions, Challenges, and Industry Applications10.1109/JRFID.2024.3387996 ↗
34. From Digital Twins to Digital Twin Prototypes: Concepts, Formalization, and Applications10.1109/ACCESS.2024.3406510 ↗
35. Martell-Chavez, F., López-Téllez, J.M., Paredes-Orta, C.A., and Espinosa-Luna, R. (2023, January 12–15). Virtual laboratories for teaching automation, robotics, and optomechatronics. Proceedings of the 2023 IEEE World Engineering Education Conference (EDUNINE), Bogota, Colombia.10.1109/EDUNINE57531.2023.10102906 ↗
36. Guc, F., Viola, J., and Chen, Y. (–15, January 15). Digital Twins Enabled Remote Laboratory Learning Experience for Mechatronics Education. Proceedings of the 2021 IEEE 1st International Conference on Digital Twins and Parallel Intelligence (DTPI), Beijing, China.10.1109/DTPI52967.2021.9540196 ↗
37. Buysse, L., Broucke, Q.V.D., Verslype, S., Peuteman, J., Boydens, J., and Pissoort, D. (2021, January 15–17). FPGA-based digital twins of microcontroller peripherals for verification of embedded software in a distance learning environment. Proceedings of the 2021 XXX International Scientific Conference Electronics (ET), Sozopol, Bulgaria.10.1109/ET52713.2021.9579770 ↗
38. Bolu, C.A., Domfang, C., Obiazi, A., Falade, F., Musa, T.A., Alinaitwe, H., Kuriakose, B., Nwobodo-Nzeribe, H.N., Mkandawire, T., and Okediji, A. (December, January 27). Appropriate Online Laboratories for Engineering Students in Africa. Proceedings of the 2022 IEEE IFEES World Engineering Education Forum—Global Engineering Deans Council (WEEF-GEDC), Cape Town, South Africa.10.1109/WEEF-GEDC54384.2022.9996210 ↗
39. Niedźwiecki, A., Jongebloed, S., Zhan, Y., Kümpel, M., Syrbe, J., and Beetz, M. (2024, January 8–11). Cloud-Based Digital Twin for Cognitive Robotics. Proceedings of the 2024 IEEE Global Engineering Education Conference (EDUCON), Kos Island, Greece.10.1109/EDUCON60312.2024.10578841 ↗
40. Papulovskaya, N., and Izotov, I. (2024, January 16–10). Internet of Things Online Laboratory: Non-Virtual Training. Proceedings of the 2024 7th International Conference on Information Technologies in Engineering Education (Inforino), Moscow, Russia.10.1109/Inforino60363.2024.10551952 ↗
41. Wang, S.I.C., Liu, E.Z.F., Huang, Y.Y., and Sang, H.Y. (2024, January 29–31). When Drone Meets AI Education: Boosting High School Students’ Computational Thinking and AI Literacy. Proceedings of the 2024 Pacific Neighborhood Consortium Annual Conference and Joint Meetings (PNC), Seoul, Republic of Korea.
42. Yu, H., and Guo, Y. (2023, January 28–30). Harnessing the Potential of Chat GPT in Education: Unveiling its Value, Navigating Challenges, and Crafting Mitigation Pathways. Proceedings of the 2023 5th International Workshop on Artificial Intelligence and Education (WAIE), Tokyo, Japan.10.1109/WAIE60568.2023.00016 ↗
43. Lundström, O., Maleki, N., and Ahlgren, F. (2024, January 8–11). Online Course Improvement Through GPT-4: Monitoring Student Engagement and Dynamic FAQ Generation. Proceedings of the 2024 IEEE Global Engineering Education Conference (EDUCON), Kos Island, Greece.10.1109/EDUCON60312.2024.10578788 ↗
44. Evaluation of LoRa Network Link Quality in Complex Urban Environments Based on Static and Dynamic Parameters10.1109/ACCESS.2024.3454636 ↗
45. Handayani, A.N., Zaeni, I.A.E., Kurniawan, W.C., and Asmara, R.A. (2020, January 19). Development of e-Collab Classroom for CNN Practice on Electrical Engineering, Universitas Negeri Malang. Proceedings of the 2020 4th International Conference on Vocational Education and Training (ICOVET), Malang, Indonesia.
46. A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospects10.1109/TNNLS.2021.3084827 ↗
47. Saini, M., Dhyani, S., Sharma, S., Awasthi, M., Yamsani, N., and Singh, P. (2024, January 2–3). Machine Learning for Enhanced Student Learning and Engagement in Interactive Classrooms. Proceedings of the 2024 2nd International Conference on Advancement in Computation & Computer Technologies (InCACCT), Gharuan, India.10.1109/InCACCT61598.2024.10551187 ↗
48. de la Torre, A., and Baldeon-Calisto, M. (2024, January 29–30). Generative Artificial Intelligence in Latin American Higher Education: A Systematic Literature Review. Proceedings of the 2024 12th International Symposium on Digital Forensics and Security (ISDFS), San Antonio, TX, USA.10.1109/ISDFS60797.2024.10527283 ↗
49. Murali, R., Ravi, N., and Surendran, A. (2024, January 8–11). Augmenting Virtual Labs with Artificial Intelligence for Hybrid Learning. Proceedings of the 2024 IEEE Global Engineering Education Conference (EDUCON), Kos Island, Greece.10.1109/EDUCON60312.2024.10578649 ↗
50. Mukhammadsidiqov, M., Akmalov, S., and Akhmedov, K. (2024, January 14–15). An Intensive Review and Assessment of Impacts of AI in the Field of Teaching(Edu). Proceedings of the 2024 4th International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), Greater Noida, India.10.1109/ICACITE60783.2024.10616640 ↗
51. A Benson, S. (August, January 29). Embracing Technologies to Facilitate Student Learning and Future Readiness. Proceedings of the 2024 International Symposium on Educational Technology (ISET), Macao, China.10.1109/ISET61814.2024.00074 ↗
52. Ren, G., Wang, T., and Wang, D. (2021, January 16–20). Construction and Application of Interactive Assessment Environment Based on Document Cloud. Proceedings of the 2021 Tenth International Conference of Educational Innovation through Technology (EITT), Chongqing, China.10.1109/EITT53287.2021.00072 ↗
53. Learning analytics in virtual laboratories: A systematic literature review of empirical research10.1186/s40561-023-00244-y ↗
54. Fernandez, I.A., Eguia, M.A., and Echeverria, L.E. (2019, January 10–13). Virtual commissioning of a robotic cell: An educational case study. Proceedings of the 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Zaragoza, Spain.10.1109/ETFA.2019.8869373 ↗
55. Jungwirth, M., Hehenberger, P., Merschak, S., Lee, W.-C., and Liao, C.-Y. (2020, January 9–11). Influence of Digitization in Mechatronics Education Programmes: A Case Study between Taiwan and Austria. Proceedings of the 2020 21st International Conference on Research and Education in Mechatronics (REM), Cracow, Poland.10.1109/REM49740.2020.9313897 ↗
56. Martinez, M.A.G., Sanchez, I.Y., and Chavez, F.M. (2021, January 7–8). Development of Automated Virtual CNC Router for Application in a Remote Mechatronics Laboratory. Proceedings of the 2021 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME), Mauritius, Mauritius.10.1109/ICECCME52200.2021.9590986 ↗
57. Music, G., Tomazic, S., and Logar, V. (2022, January 1–3). Distance Learning of Programmable Logic Control: An Implementation Example. Proceedings of the 2022 29th International Conference on Systems, Signals and Image Processing (IWSSIP), Sofia, Bulgaria.10.1109/IWSSIP55020.2022.9854423 ↗
58. Riveros, L.F.R., Tristancho, V.H.B., Sanabria, J.E.S., and Amado, H.D.V. (July, January 29). Digital Twins, Didactic Strategy for Teaching Industrial Automation. Proceedings of the 2022 Congreso de Tecnología, Aprendizaje y Enseñanza de la Electrónica (XV Technologies Applied to Electronics Teaching Conference (TAEE), Teruel, Spain.10.1109/TAEE54169.2022.9840602 ↗
59. Fletscher, L., Botero, J.F., Gaviria, N., Aza, E.F., and Vergara, J. (2020, January 27–30). RECoNE: A Remote Environment for Computer Networks Education. Proceedings of the 2020 IEEE Global Engineering Education Conference (EDUCON), Porto, Portugal.10.1109/EDUCON45650.2020.9125383 ↗
60. Bachiri, Y.-A., and Mouncif, H. (2020, January 28–30). Applicable strategy to choose and deploy a MOOC platform with multilingual AQG feature. Proceedings of the 2020 21st International Arab Conference on Information Technology (ACIT), Giza, Egypt.10.1109/ACIT50332.2020.9300051 ↗
61. Nalawati, R.E., and Yuntari, A.D. (2021, January 14–15). Ratcliff/Obershelp Algorithm as An Automatic Assessment on E-Learning. Proceedings of the 2021 4th International Conference of Computer and Informatics Engineering (IC2IE), Depok, Indonesia.10.1109/IC2IE53219.2021.9649217 ↗
62. Hassan, H.A., Eid, M.M., Elmesalawy, M.M., and El-Haleem, A.M.A. (2022, January 4–6). A New Intelligent System for Evaluating and Assisting Students in Laboratory Learning Management System. Proceedings of the 2022 14th International Conference on Computational Intelligence and Communication Networks (CICN), Al-Khobar, Saudi Arabia.10.1109/CICN56167.2022.10008322 ↗
63. Disa, S., and Idkhan, A.M. (2022, January 8–9). Web e-Learning: Automated Essay Assessment Based on Natural Language Processing Using Vector Space Model. Proceedings of the 2022 4th International Conference on Cybernetics and Intelligent System (ICORIS), Prapat, Indonesia.10.1109/ICORIS56080.2022.10031317 ↗
64. Tulha, C.N., Carvalho, M.A.G., and de Castro, L.N. (2022, January 1–3). LEDA: A Learning Analytics Based Framework to Analyze Remote Labs Interaction. Proceedings of the L@S ’22: Ninth (2022) ACM Conference on Learning @ Scale, New York, NY, USA.10.1145/3491140.3528324 ↗
65. Protic, A., Jin, Z., Marian, R., Abd, K., Campbell, D., and Chahl, J. (2020, January 14–17). Implementation of a Bi-Directional Digital Twin for Industry 4 Labs in Academia: A Solution Based on OPC UA. Proceedings of the 2020 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM), Singapore.10.1109/IEEM45057.2020.9309953 ↗
66. Classens, K., Heemels, W.M., and Oomen, T. (August, January 15). Digital Twins in Mechatronics: From Model-based Control to Predictive Maintenance. Proceedings of the 2021 IEEE 1st International Conference on Digital Twins and Parallel Intelligence (DTPI), Beijing, China.10.1109/DTPI52967.2021.9540144 ↗