journal article·2022Open access

Sign Language to Sentence Formation: A Real Time Solution for Deaf People

Muhammad Sanaullah, Muhammad Kashif, Babar Ahmad, Tauqeer Safdar, Mehdi Hassan, Mohd Hilmi Hasan, Amir Haider

Computers, Materials & Continua· Volume 72· Issue 2

Abstract

Communication is a basic need of every human being to exchange thoughts and interact with the society. Acute peoples usually confab through different spoken languages, whereas deaf people cannot do so. Therefore, the Sign Language (SL) is the communication medium of such people for their conversation and interaction with the society. The SL is expressed in terms of specific gesture for every word and a gesture is consisted in a sequence of performed signs. The acute people normally observe these signs to understand the difference between single and multiple gestures for singular and plural words respectively. The signs for singular words such as I, eat, drink, home are unalike the plural words as school, cars, players. A special training is required to gain the sufficient knowledge and practice so that people can differentiate and understand every gesture/sign appropriately. Innumerable researches have been performed to articulate the computer-based solution to understand the single gesture with the help of a single hand enumeration. The complete understanding of such communications are possible only with the help of this differentiation of gestures in computer-based solution of SL to cope with the real world environment. Hence, there is still a demand for specific environment to automate such a communication solution to interact with such type of special people. This research focuses on facilitating the deaf community by capturing the gestures in video format and then mapping and differentiating as single or multiple gestures used in words. Finally, these are converted into the respective words/sentences within a reasonable time. This provide a real time solution for the deaf people to communicate and interact with the society.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Hand Gesture Recognition Systems · Hearing Impairment and Communication · English Language Learning and Teaching

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (18)

Show source-provided references
1. World Health Organization, https://www.who.int/news-room/fact-sheets/detail/deafness-and-hearing-loss. Accessed: 2020-02-02.
2. World Health Organization, https://www.yesprograms.org/stories/sign-language-accessibility-for-the-deaf-in-pakistan. Accessed: 2020-02-02.
3. U.S deaf population, https://www.gallaudet.edu/office-of-international-affairs/demographics/deafemploy ment-reports. Accessed: 2020-10-07.
4. American sign language translation through sensory glove
5. Helderman · BS Project · 2016
6. Deep learning-based sign language recognition system for static signs10.1007/s00521-019-04691-y ↗
7. Assistive glove for Pakistani sign language translation
8. Development of a wearable device for sign language recognition
9. Real time sign language recognition using artificial neural networks
10. Real-time sign language finger spelling recognition using convolutional neural networks from depth map
11. A deep neural framework for continuous sign language recognition by iterative training”,10.1109/TMM.2018.2889563 ↗
12. Real-time Malaysian sign language translation using colour segmentation and neural network
13. Recognition of arabic sign language (arsl) using recurrent neural networks
14. American sign language recognition using deep learning and computer vision
15. A modified lstm model for continuous sign language recognition using leap motion10.1109/JSEN.2019.2909837 ↗
16. Multiple proposals for continuous arabic sign language recognition10.1007/s11220-019-0225-3 ↗
17. S. Ullah, Z. Mumtaz, S. Liu, M. Abubaqr, A. Mahboobet et al., “An automated robot-car control system with hand-gestures and mobile application using arduino,” Sensing and Image, preprint, 2019.10.20944/preprints201901.0029.v1 ↗
18. Pakistan sign language. https://www.psl.org.pk/signs. Accessed: 2020-02-02.