Digital Human Technology in E-Learning: Custom Content Solutions
Source abstract
Abstract
With advances in digital transformation (DX) in education and digital technologies becoming more deeply integrated into educational settings, global demand for video-based learning materials continues to rise, resulting in substantial effort being required from teachers to create e-learning videos. Furthermore, while many existing services offer visual content, they primarily rely on templates, making it challenging to design custom content that addresses specific needs. In this study, we develop a web service that facilitates e-learning video creation through integrated artificial intelligence (AI) and digital human technology. This service enhances educational content by integrating digital human characters and voice synthesis technologies, aiming to create comprehensive e-learning videos by incorporating visual motion and synchronized audio into educational content. In addition, this service also aims to enable the creation of engaging content through advanced visuals and animations, effectively maintaining learner interest.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Online Learning and Analytics · AI in Service Interactions · Engineering Education and Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Center of Mathematical and Data Sciences, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan
Graduate School of Engineering, Faculty of Engineering, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan
Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan
Lab of Sediment Hazards and Disaster Risk, Graduate School of Maritime Sciences, Kobe University, 5-1-1 Fukae Minamicho, Higashinada-ku, Kobe 658-0022, Japan
Graduate School of Human Development and Environment, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan
Department of Computer Science and Engineering, Waseda University, 1-104 Totsukamachi, Shinjuku-ku, Tokyo 169-8050, Japan
Funding
CMDS Joint Project Promoting DX Inside & Outside the University
References (51)
Show source-provided references
1. Resendiz Calderon, C., Farfan-Cabrera, L., Cazares, I., Najera, P., and Okoye, K. (2024). Assessing benefits of computer-based video training and tools on learning outcomes and motivation in mechanical engineering education: Digitalized intervention and approach. Front. Educ., 9.10.3389/feduc.2024.1292405 ↗
2. Digitalization of education in modern scientific discourse: New trends and risks analysis
3. From dual digitalization to digital learning space: Exploring the digital transformation of higher education10.1016/j.compedu.2022.104463 ↗
4. Medical students’ digital education of communication skills: Systematic review and meta-analysis by the Digital Health Education Collaboration (Preprint)10.2196/12967 ↗
5. Systematic review of research on artificial intelligence applications in higher education—Where are the educators?10.1186/s41239-019-0171-0 ↗
6. Education in the Context of Digitalization and Culture: Evolution of the Teacher’s Role, Pre-pandemic Overview10.29333/ejecs/629 ↗
7. Chan, A., Ezell, C., Kaufmann, M., Wei, K., Hammond, L., Bradley, H., Bluemke, E., Rajkumar, N., Krueger, D., and Kolt, N. (2024, January 3–6). Visibility into AI Agents. Proceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency, Rio de Janeiro, Brazil. FAccT ’24.10.1145/3630106.3658948 ↗
8. Artificial intelligence (AI) student assistants in the classroom: Designing chatbots to support student success10.1007/s10796-022-10291-4 ↗
9. Bozkurt, A., Karadeniz, A., Baneres, D., Guerrero-Roldán, A.E., and Rodríguez, M.E. (2021). Artificial intelligence and reflections from educational landscape: A review of AI Studies in half a century. Sustainability, 13.10.3390/su13020800 ↗
10. Utilizing Text-to-Speech Technology: Natural Reader in Teaching Pronunciation
11. Dai, L., Kritskaia, V., Velden, E., Jung, M., Postma, M., and Louwerse, M. (2022, January 21–23). Evaluating the usage of Text-To-Speech in K12 education. Proceedings of the 2022 6th International Conference on Education and E-Learning, Yamanashi, Japan.10.1145/3578837.3578864 ↗
12. Recognitions of image and speech to improve learning diagnosis on STEM collaborative activity for precision education
13. Luo, H. (2023). Advances in multimodal learning: Pedagogies, technologies, and analytics. Front. Psychol., 14.10.3389/fpsyg.2023.1286092 ↗
14. Immadisetty, P., Rajesh, P., Gupta, A., Anala, M.R., Soumya, A., and Subramanya, K.N. (2023). Multimodality in Online Education: A Comparative Study. arXiv.
15. Mulian, H., Shlomov, S., Limonad, L., Noccaro, A., and Buscaglione, S. (2024, January 20–27). Mimicking the Maestro: Exploring the Efficacy of a Virtual AI Teacher in Fine Motor Skill Acquisition. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i21.30369 ↗
16. Liu, R., Sisman, B., Li, J., Bao, F., Gao, G., and Li, H. (2020, January 4–8). Teacher-Student Training For Robust Tacotron-Based TTS. Proceedings of the 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9054681 ↗
17. Elai.io (2025, March 22). AI-Powered E-Learning Video Generation. Available online: https://elai.io/e-learning/.
18. Vyond (2025, March 22). Training and E-Learning Video Solutions. Available online: https://www.vyond.com/solutions/training-and-elearning-videos/.
19. AI Studios (2024, December 24). AI Studios: AI-Powered Virtual Humans for Video Creation. Available online: https://www.aistudios.com.
20. Haji-Ali, M., Menapace, W., Siarohin, A., Skorokhodov, I., Canberk, A., Lee, K.S., Ordonez, V., and Tulyakov, S. (2024). AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation. arXiv.
21. Tits, N. (2022). Controlling the Emotional Expressiveness of Synthetic Speech: A Deep Learning Approach, Springer.
22. Stoyanova-Doycheva, A., Ivanova, V., Doukovska, L., Tabakova, V., Radeva, I., and Danailova, S. (October, January 30). Architecture of a Knowledge Base in Smart Crop Production. Proceedings of the 2021 International Conference Automatics and Informatics (ICAI), Varna, Bulgaria.10.1109/ICAI52893.2021.9639874 ↗
23. Mayer, R.E. (2009). Multimedia Learning, Cambridge University Press. [2nd ed.].
24. DeepSeek (2024, December 24). DeepSeek: AI-powered Search Engine. Available online: https://www.deepseek.com.
25. Wikipedia Contributors (2024, December 24). Isaac Newton—Wikipedia. Available online: https://en.wikipedia.org/wiki/Isaac_Newton.
26. Inaguma, H., Kiyono, S., Duh, K., Karita, S., Yalta, N., Hayashi, T., and Watanabe, S. (2020, January 5–10). ESPnet-ST: All-in-One Speech Translation Toolkit. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations, Online.10.18653/v1/2020.acl-demos.34 ↗
27. Hayashi, T., Yamamoto, R., Yoshimura, T., Wu, P., Shi, J., Saeki, T., Ju, Y., Yasuda, Y., Takamichi, S., and Watanabe, S. (2021). ESPnet2-TTS: Extending the edge of TTS research. arXiv.
28. Li, C., Shi, J., Zhang, W., Subramanian, A.S., Chang, X., Kamo, N., Hira, M., Hayashi, T., Boeddeker, C., and Chen, Z. (2021, January 19–22). ESPnet-SE: End-to-End Speech Enhancement and Separation Toolkit Designed for ASR Integration. Proceedings of the IEEE Spoken Language Technology Workshop (SLT), Shenzhen, China.10.1109/SLT48900.2021.9383615 ↗
29. Arora, S., Dalmia, S., Denisov, P., Chang, X., Ueda, Y., Peng, Y., Zhang, Y., Kumar, S., Ganesan, K., and Yan, B. (2022, January 7–13). ESPnet-SLU: Advancing Spoken Language Understanding through ESPnet. Proceedings of the ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Virtual.10.1109/ICASSP43922.2022.9747674 ↗
30. Shi, J., Guo, S., Qian, T., Huo, N., Hayashi, T., Wu, Y., Xu, F., Chang, X., Li, H., and Wu, P. (2022, January 18–22). Muskits: An End-to-End Music Processing Toolkit for Singing Voice Synthesis. Proceedings of the Interspeech, Incheon, Republic of Korea.10.21437/Interspeech.2022-10039 ↗
31. Lu, Y.J., Chang, X., Li, C., Zhang, W., Cornell, S., Ni, Z., Masuyama, Y., Yan, B., Scheibler, R., and Wang, Z.Q. (2022, January 18–22). ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding. Proceedings of the Interspeech, Incheon, Republic of Korea.10.21437/Interspeech.2022-10727 ↗
32. Gao, D., Shi, J., Chuang, S.P., Garcia, L.P., Lee, H.y., Watanabe, S., and Khudanpur, S. (2023, January 4–10). EURO: ESPnet unsupervised ASR open-source toolkit. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096977 ↗
33. Peng, Y., Tian, J., Yan, B., Berrebbi, D., Chang, X., Li, X., Shi, J., Arora, S., Chen, W., and Sharma, R. (2023, January 16–20). Reproducing Whisper-style training using an open-source toolkit and publicly available data. Proceedings of the 2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Taipei, Taiwan.10.1109/ASRU57964.2023.10389676 ↗
34. Sharma, R., Chen, W., Kano, T., Sharma, R., Arora, S., Watanabe, S., Ogawa, A., Delcroix, M., Singh, R., and Raj, B. (2023, January 16–20). ESPnet-SUMM: Introducing a novel large dataset, toolkit, and a cross-corpora evaluation of speech summarization systems. Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), Taipei, Taiwan.10.1109/ASRU57964.2023.10389641 ↗
35. Jung, J.w., Zhang, W., Shi, J., Aldeneh, Z., Higuchi, T., Theobald, B.J., Abdelaziz, A.H., and Watanabe, S. (2024, January 1–5). ESPnet-SPK: Full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models. Proceedings of the Interspeech, Kos Island, Greece.10.21437/Interspeech.2024-1345 ↗
36. Yan, B., Shi, J., Tang, Y., Inaguma, H., Peng, Y., Dalmia, S., Polák, P., Fernandes, P., Berrebbi, D., and Hayashi, T. (2023, January 10–12). ESPnet-ST-v2: Multipurpose Spoken Language Translation Toolkit. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 3: System Demonstrations), Toronto, ON, Canada.10.18653/v1/2023.acl-demo.38 ↗
37. Getimg.ai (2024, December 26). Getimg.ai—AI-Powered Image Generation. Available online: https://getimg.ai/home.
38. Siarohin, A., Lathuilière, S., Tulyakov, S., Ricci, E., and Sebe, N. (2019, January 8–14). First Order Motion Model for Image Animation. Proceedings of the Conference on Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada.
39. Wei, H., Yang, Z., and Wang, Z. (2024). AniPortrait: Audio-Driven Synthesis of Photorealistic Portrait Animations. arXiv.
40. Chen, Z., Cao, J., Chen, Z., Li, Y., and Ma, C. (2024). EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning. arXiv.
41. Meng, R., Zhang, X., Li, Y., and Ma, C. (2024). EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animation. arXiv.
42. Semantic matching in search10.1561/1500000035 ↗
43. Priest, G. (2014). Contradictory concepts. Logic Reason. Ration., 197–215.10.1007/978-94-017-9011-6_10 ↗
44. Deng, N., Wang, Y., Huang, G., Zhou, Y., and Li, Y. (2023). Semantic Coherence Analysis of English Texts Based on Sentence Semantic Graphs. Icst Trans. Scalable Inf. Syst., 10.10.4108/eetsis.3312 ↗
45. Measures and perceptions of liveliness in student oral presentation speech: A proposal for an automatic feedback mechanism10.1016/j.system.2005.04.002 ↗
46. Kumar, S., Phadikar, S., and Majumder, K. (2016, January 16–18). Modified segmentation algorithm based on Short Term Energy & Zero Crossing Rate for Maithili speech signal. Proceedings of the 2016 International Conference on Accessibility to Digital World (ICADW), Guwahati, India.10.1109/ICADW.2016.7942535 ↗
47. Tobin, J., Li, Q., Venugopalan, S., Seaver, K., Cave, R., and Tomanek, K. (2022). Assessing asr model quality on disordered speech using bertscore. arXiv.10.21437/S4SG.2022-6 ↗
48. Automated detection of high frequency oscillations in intracranial EEG using the combination of short-time energy and convolutional neural networks10.1109/ACCESS.2019.2923281 ↗
49. Pitch dynamism in female and male speech10.1016/0271-5309(94)00011-Z ↗
50. Trouvain, J. (2004). Tempo variation in speech production. Implic. Speech Synthesis. Phonus, 8.
51. Prajwal, K., Mukhopadhyay, R., Namboodiri, V.P., and Jawahar, C. (2020, January 12–16). A lip sync expert is all you need for speech to lip generation in the wild. Proceedings of the 28th ACM International Conference on Multimedia, Virtual.10.1145/3394171.3413532 ↗