journal article·2021Open access

Improving Language Translation Using the Hidden Markov Model

Yunpeng Chang, Xiaoliang Wang, Meihua Xue, Yuzhen Liu, Frank Jiang

Computers, Materials & Continua· Volume 67· Issue 3

Abstract

Translation software has become an important tool for communication between different languages. People’s requirements for translation are higher and higher, mainly reflected in people’s desire for barrier free cultural exchange. With a large corpus, the performance of statistical machine translation based on words and phrases is limited due to the small size of modeling units. Previous statistical methods rely primarily on the size of corpus and number of its statistical results to avoid ambiguity in translation, ignoring context. To support the ongoing improvement of translation methods built upon deep learning, we propose a translation algorithm based on the Hidden Markov Model to improve the use of context in the process of translation. During translation, our Hidden Markov Model prediction chain selects a number of phrases with the highest result probability to form a sentence. The collection of all of the generated sentences forms a topic sequence. Using probabilities and article sequences determined from the training set, our method again applies the Hidden Markov Model to form the final translation to improve the context relevance in the process of translation. This algorithm improves the accuracy of translation, avoids the combination of invalid words, and enhances the readability and meaning of the resulting translation.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Natural Language Processing Techniques · Topic Modeling · Multimodal Machine Learning Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (21)

Show source-provided references
1. A secure fabric blockchain based data transmission technique for industrial IoT10.1109/TII.2019.2907092 ↗
2. Deep reinforcement learning for resource protection and real-time detection in IoT environment10.1109/JIOT.2020.2974281 ↗
3. Future-aware knowledge distillation for neural machine translation10.1109/TASLP.2019.2946480 ↗
4. Parallel development of machine translation and artificial intelligence
5. Research and development of machine translation technology
6. Neural machine translation by jointly learning to align and translate
7. Yang · Research and Implementation of Uygur Chinese Translation Based on Neural Network · 2019
8. Machine translation system based on self attention model
9. Online adaptation strategies for statistical machine translation in post-editing scenarios
10. Neural machine translation with sentence-level topic context10.1109/TASLP.2019.2937190 ↗
11. A unified framework and models for integrating translation memory into phrase-based statistical machine translation10.1016/j.csl.2018.09.006 ↗
12. Word sense disambiguation by sequential patterns in sentences10.1017/S1351324913000259 ↗
13. Online learning for effort reduction in interactive neural machine translation10.1016/j.csl.2019.04.001 ↗
14. Neural machine translation by jointly learning to align and translate
15. Exploiting reverse target-side contexts for neural machine translation via asynchronous bidirectional decoding10.1016/j.artint.2019.103168 ↗
16. Discriminative ridge regression algorithm for adaptation in statistical machine translation10.1007/s10044-018-0720-5 ↗
17. The parallel corpus for information extraction based on natural language processing and machine translation
18. Training deeper neural machine translation models with transparent attention
19. Exploiting deep representations for neural machine translation
20. Dense information flow for neural machine translation
21. A neural network for factoid question answering over paragraphs