journal article·2022Open access

Sign Language Recognition and Classification Model to Enhance Quality of Disabled People

Fadwa Alrowais, Saud S. Alotaibi, Sami Dhahbi, Radwa Marzouk, Abdullah Mohamed, Anwer Mustafa Hilal

Computers, Materials & Continua· Volume 73· Issue 2

Abstract

Sign language recognition can be considered as an effective solution for disabled people to communicate with others. It helps them in conveying the intended information using sign languages without any challenges. Recent advancements in computer vision and image processing techniques can be leveraged to detect and classify the signs used by disabled people in an effective manner. Metaheuristic optimization algorithms can be designed in a manner such that it fine tunes the hyper parameters, used in Deep Learning (DL) models as the latter considerably impacts the classification results. With this motivation, the current study designs the Optimal Deep Transfer Learning Driven Sign Language Recognition and Classification (ODTL-SLRC) model for disabled people. The aim of the proposed ODTL-SLRC technique is to recognize and classify sign languages used by disabled people. The proposed ODTL-SLRC technique derives EfficientNet model to generate a collection of useful feature vectors. In addition, the hyper parameters involved in EfficientNet model are fine-tuned with the help of HGSO algorithm. Moreover, Bidirectional Long Short Term Memory (BiLSTM) technique is employed for sign language classification. The proposed ODTL-SLRC technique was experimentally validated using benchmark dataset and the results were inspected under several measures. The comparative analysis results established the superior performance of the proposed ODTL-SLRC technique over recent approaches in terms of efficiency.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Hand Gesture Recognition Systems · Gait Recognition and Analysis · Digital Imaging for Blood Diseases

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (20)

Show source-provided references
1. Recognition of sign language using capsule networks
2. A review on systems-based sensory gloves for sign language recognition state of the art between 2007 and 201710.3390/s18072208 ↗
3. Kumar · Smart Intelligent Computing and Applications, Smart Innovation, Systems and Technologies Book Series · 2019 · 104 · 603
4. A lightweight CNN based on transfer learning for COVID-19 diagnosis10.32604/cmc.2022.024589 ↗
5. Review of unsupervised person re-identification10.32604/jnm.2021.023981 ↗
6. Sign language planning and policy in ontario teacher education10.1007/s10993-020-09569-7 ↗
7. An intelligent system to help deaf students learn arabic sign language10.1080/10494820.2021.1920431 ↗
8. A novel approach for iSL alphabet recognition using extreme learning machine10.1007/s41870-020-00525-6 ↗
9. An integrated CNN-lSTM model for bangla lexical sign language recognition
10. Signtalk: Sign language to text and speech conversion
11. Recognition of amharic sign language with amharic alphabet signs using ANN and SVM
12. Feature optimization on dual leap motion controller for Indonesian sign language
13. Deep-hand: A deep inference vision approach of recognizing a hand sign language using American alphabet
14. Azizan · Human-centered Technology for a Better Tomorrow, Lecture Notes in Mechanical Engineering Book Series · 2022 · 11510.1007/978-981-16-4115-2_9 ↗
15. Design of intelligent human-computer interaction system for hard of hearing and non-disabled people10.1109/JSEN.2021.3107949 ↗
16. Plant leaf disease classification using efficientNet deep learning model10.1016/j.ecoinf.2020.101182 ↗
17. Henry gas solubility optimization: A novel physics-based algorithm10.1016/j.future.2019.07.015 ↗
18. Tardb-net: Triple-attention guided residual dense and BiLSTM networks for hyperspectral image classification10.1007/s11042-020-10188-x ↗
19. https://www.kaggle.com/grassknoted/asl-alphabet?select=asl_alphabet_test.
20. Deep learning-based sign language recognition system for static signs10.1007/s00521-019-04691-y ↗