journal article·2023Open access

Recognition of Human Actions through Speech or Voice Using Machine Learning Techniques

Oscar Peña-Cáceres, Henry Silva-Marchan, Manuela Albert, Miriam Gil

Computers, Materials & Continua· Volume 77· Issue 2

Abstract

The development of artificial intelligence (AI) and smart home technologies has driven the need for speech recognition-based solutions. This demand stems from the quest for more intuitive and natural interaction between users and smart devices in their homes. Speech recognition allows users to control devices and perform everyday actions through spoken commands, eliminating the need for physical interfaces or touch screens and enabling specific tasks such as turning on or off the light, heating, or lowering the blinds. The purpose of this study is to develop a speech-based classification model for recognizing human actions in the smart home. It seeks to demonstrate the effectiveness and feasibility of using machine learning techniques in predicting categories, subcategories, and actions from sentences. A dataset labeled with relevant information about categories, subcategories, and actions related to human actions in the smart home is used. The methodology uses machine learning techniques implemented in Python, extracting features using CountVectorizer to convert sentences into numerical representations. The results show that the classification model is able to accurately predict categories, subcategories, and actions based on sentences, with 82.99% accuracy for category, 76.19% accuracy for subcategory, and 90.28% accuracy for action. The study concludes that using machine learning techniques is effective for recognizing and classifying human actions in the smart home, supporting its feasibility in various scenarios and opening new possibilities for advanced natural language processing systems in the field of AI and smart homes.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Context-Aware Activity Recognition Systems · IoT-based Smart Home Systems · AI in Service Interactions

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (41)

Show source-provided references
1. Voice emotion detection: Acoustic features extraction using multi-layer perceptron classifier algorithm
2. Human-machine interaction via dual modes of voice and gesture enabled by triboelectric nanogenerator and machine learning10.1021/acsami.3c00566 ↗
3. Low-cost android app based voice operated room automation system
4. Voice controlled bedroom using aiy google kit
5. Smart assistant robot for smart home management
6. Implementation of the wake word for smart home automation system
7. Classification of human emotion from speech data using deep learning
8. Intelligent voice assistant by using OpenCV approach
9. Augmented reality and speech control from automobile showcasing
10. Action recognition based on multimode fusion for VR online platform10.1007/s10055-023-00773-4 ↗
11. Implementation of low-cost voice command robot using arduino uno platform
12. Controlling electronic devices remotely by voice and brain waves
13. A speech to machine interface based on the frequency domain command recognition
14. Resident identification in smart home by voice biometrics
15. Control of smart home operations using natural language processing, voice recognition and IoT technologies in a multi-tier architecture10.3390/designs3030032 ↗
16. Harris hawks sparse auto-encoder networks for automatic speech recognition system10.3390/app12031091 ↗
17. WalkID: Towards context awareness of smart home by identifying walking sounds
18. Deep learning speech recognition for residential assistant robot
19. Deep learning for intelligent human-computer interaction10.3390/app122211457 ↗
20. Scenario-based programming of voice-controlled medical robotic systems10.3390/s22239520 ↗
21. Smarthome control unit using vietnamese speech command10.1007/978-3-030-33585-4_29 ↗
22. A robust intelligence regression model for monitoring Parkinson’s disease based on speech signals10.1016/j.future.2023.05.012 ↗
23. Spontaneous visual database for detecting learning-centered emotions during online learning10.1016/j.imavis.2023.104739 ↗
24. Ensemble deep learning in speech signal tasks: A review10.1016/j.neucom.2023.126436 ↗
25. Design and implementation of intelligent car controlled by voice
26. An online classroom question answering evaluation system based on voiceprint and behavior recognition
27. Collaborative learning environment over internet using augmented reality and voice interaction
28. The human assistant system
29. Assistive technologies for supporting the wellbeing of older adults10.3390/technologies10010008 ↗
30. Bangla toxic comment classification (machine learning and deep learning approach)
31. Predicting activities of daily living for the coming time period in smart homes10.1109/THMS.2022.3176213 ↗
32. An imperceptible method to monitor human activity by using sensor data with cnn and bidirectional LSTM10.17762/ijritcc.v11i2s.6033 ↗
33. The engagement of students when learning to use a personal audio classifier to control robot cars in a computational thinking board game10.1186/s41039-022-00202-1 ↗
34. X-CHAR: A concept-based explainable complex human activity recognition model
35. Multilayer neural network based speech emotion recognition for smart assistance10.32604/cmc.2023.028631 ↗
36. Value evaluation of human motion simulation based on speech recognition control10.1007/s13198-021-01584-z ↗
37. Human-robot communication system for an isolated environment10.1109/ACCESS.2022.3183110 ↗
38. Machine learning based human recognition via robust features from audio signals
39. Voice-based intelligent virtual assistant for windows
40. mySmartCart: A smart shopping list for day-to-day supplies
41. Forecasting and optimization stock predictions: Varying asset profile, time window, and hyperparameter factors10.1016/j.sasc.2023.200052 ↗