An End-to-End Transformer-Based Automatic Speech Recognition for Qur’an Reciters
Source abstract
Abstract
The attention-based encoder-decoder technique, known as the trans-former, is used to enhance the performance of end-to-end automatic speech recognition (ASR). This research focuses on applying ASR end-to-end transformer-based models for the Arabic language, as the researchers’ community pays little attention to it. The Muslims Holy Qur’an book is written using Arabic diacritized text. In this paper, an end-to-end transformer model to building a robust Qur’an vs. recognition is proposed. The acoustic model was built using the transformer-based model as deep learning by the PyTorch framework. A multi-head attention mechanism is utilized to represent the encoder and decoder in the acoustic model. A Mel filter bank is used for feature extraction. To build a language model (LM), the Recurrent Neural Network (RNN) and Long short-term memory (LSTM) were used to train an n-gram word-based LM. As a part of this research, a new dataset of Qur’an verses and their associated transcripts were collected and processed for training and evaluating the proposed model, consisting of 10 h of .wav recitations performed by 60 reciters. The experimental results showed that the proposed end-to-end transformer-based model achieved a significant low character error rate (CER) of 1.98% and a word error rate (WER) of 6.16%. We have achieved state-of-the-art end-to-end transformer-based recognition for Qur’an reciters.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Speech Recognition and Synthesis · Natural Language Processing Techniques · Historical and Linguistic Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. Weninger · The Semitic Languages an International Handbook · 201110.1515/9783110251586 ↗
2. Abjad: Towards interactive learning approach to Arabic reading based on speech recognition10.1016/j.procs.2018.10.476 ↗
3. Design of Arabic diacritical marks
4. The linguistic impact of the Quran on Arabic10.18630/kaall.2013.17.1.001 ↗
5. The Koran interpreted: A translation10.2307/598054 ↗
6. The difference in Qur’anic readings in the interpretation of Al-Tabari and its effect on jurisprundential rulings: An analytical study10.37231/jimk.2018.16.1.252 ↗
7. Ilmu Tajwid dan implikasinya terhadap ilmu qira’ah10.30762/qof.v1i1.926 ↗
8. A deep learning approach for automatic speech recognition of the Holy Qur’ān recitations10.1007/s10772-021-09853-9 ↗
9. Analysis and implementation of a Quranic verses delimitation system in audio files using speech recognition techniques
10. Automatic speech recognition (ASR) systems for learning Arabic language and Al-Quran recitation: A review10.47760/ijcsmc.2021.v10i07.013 ↗
11. Hybrid HMM-BLSTM-based acoustic modeling for automatic speech recognition on Quran recitation
12. End-to-end Arabic speech recognition: A review
13. A review: Isolated Arabic words recognition using artificial intelligent techniques
14. The problems, issues and future challenges of automatic speech recognition for Quranic verse recitation: A review
15. Arabic speech recognition by end-to-end, modular systems and human10.1016/j.csl.2021.101272 ↗
16. Transformer-based Arabic dialect identification
17. Non-diacritized Arabic speech recognition based on CNN-LSTM and attention-based models10.3233/JIFS-202841 ↗
18. A machine learning approach for recognizing the Holy Quran reciter10.14569/IJACSA.2020.0110735 ↗
19. An efficient Holy Quran recitation recognizer based on SVM learning model
20. Arabic audio clips: Identification and discrimination of authentic cantillations from imitations10.1016/j.neucom.2020.07.099 ↗
21. Ar-DAD: Arabic diversified audio dataset10.1016/j.dib.2020.106503 ↗
22. Recognition of Holy Quran recitation rules using phoneme duration
23. Development of Quranic reciter identification system using MFCC and GMM classifier
24. SMARTAJWEED automatic recognition of Arabic Quranic recitation rules
25. Quranic reciter recognition: A machine learning approach10.25046/aj040621 ↗
26. Development of Quran reciter identification system using MFCC and neural network10.11591/ijeecs.v1.i1.pp168-175 ↗
27. Feature extraction of some Quranic recitation using Mel-Frequency Cepstral Coeficients (MFCC)
28. An automatic qari recognition system
29. Mad reading law classification using Mel Frequency Cepstal Coefficient (MFCC) and Hidden Markov Model (HMM)10.21070/pels.v2i0.1148 ↗
30. Approach for recognizing allophonic sounds of the classical Arabic based on Quran recitations10.1007/978-3-642-45008-2_5 ↗
31. Arabic speech recognition using end-to-end deep learning10.1049/sil2.12057 ↗
32. Long short-term memory recurrent neural network architectures for large scale acoustic modeling
33. State-of-the-art speech recognition with sequence-to-sequence models
34. Exploring architectures, data and units for streaming end-to-end speech recognition with RNN-transducer
35. Listen, attend and spell: A neural network for large vocabulary conversational speech recognition
36. Chorowski · Advances in Neural Information Processing Systems · 2015 · 1
37. C. Wu, “Structured deep neural networks for speech recognition,” Ph.D. Dissertation, University of Cambridge, United Kingdom, 2018.
38. Design, analysis and experimental evaluation of block based transformation in MFCC computation for speaker recognition10.1016/j.specom.2011.11.004 ↗
39. Hybrid gray wolf and particle swarm optimization for feature selection
40. Dipper throated optimization algorithm forunconstrained function and feature selection10.32604/cmc.2022.026026 ↗
41. A binary sine cosine-modified whale optimization algorithm for feature selection
42. Adaptive dynamic meta-heuristics for feature selection and classification in diagnostic accuracy of transformer faults10.1109/ACCESS.2021.3083593 ↗
43. Meta-heuristics for feature selection and classification in diagnostic breast cancer10.32604/cmc.2022.029605 ↗
44. Novel meta-heuristic algorithm for feature selection, unconstrained functions and engineering problems10.1109/ACCESS.2022.3166901 ↗
45. End-to-end speech recognition with word-based RNN language models
46. Espresso: A fast End-to-end neural speech recognition toolkit
47. Speech-transformer: A no-recurrence sequence-to-sequence model for speech recognition