Neural Machine Translation of Electrical Engineering Based on Vector Fusion
Source abstract
Abstract
The development of neural machine translation has achieved a good translation effect on large-scale general corpora, but there are still many problems in the translation of low resources and specific fields. This paper studies the problem of machine translation in the field of electrical engineering and fuses the multi-layer vectors at the encoder side of the model. On this basis, the decoder unit of the translation model is improved, and a multi-attention mechanism translation model based on vector fusion is proposed, which improves the ability of the model to extract features and achieves a better translation effect on Chinese-English translation tasks. The experimental results show that the BLEU (bilingual evaluation understudy) value of the improved translation system in the field of electrical engineering has increased by 0.15–1.58 percentage points.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Natural Language Processing Techniques · Topic Modeling · Cancer-related molecular mechanisms research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Engineering, Henan University of Science and Technology, Luoyang 471023, China
Henan Province New Energy Vehicle Power Electronics and Power Transmission Engineering Research Center, Luoyang 471023, China
School of Foreign Languages, Henan University of Science and Technology, Luoyang 471023, China
References (34)
Show source-provided references
1. Zhang, Z. (2010). Introduction to Computer Linguistics and Machine Translation, Foreign Language Teaching and Research Press.
2. Rule-Based Machine Translation Technology Review
3. Survey on Statistical Machine Translation
4. Nal, K., and Blunsom, P. (2013, January 1–13). Recurrent Continuous Translation Models. Proceedings of the Paper presented at the Conference on Empirical Methods in Natural Language Processing 2013, Seattle, WA, USA.
5. Ilya, S., Vinyals, O., and Le, Q.V. (2014). Sequence to Sequence Learning with Neural Networks. Paper presented at the NIPS 2014. arxiv.
6. Dzmitry, B., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.
7. Wu, Y., Schuster, M., Chen, Z., Le, Q.V., Norouzi, M., Macherey, W., Krikun, M., Cao, Y., Gao, Q., and Macherey, K. (2016). Corrado, Macduff Hughes, and Jeffrey Dean. Google’s Neural Machine Translation System: Bridging the Gap between Human and Machine Translation. arXiv.
8. Jonas, G., Auli, M., Grangier, D., and Dauphin, Y. (2016). A Convolutional Encoder Model for Neural Machine Translation. arXiv.
9. Jonas, G., Auli, M., Grangier, D., Yarats, D., and Dauphin, Y. (2017, January 6–11). Convolutional Sequence to Sequence Learning. Proceedings of the Paper Presented at the International Conference on Machine Learning 2017, Sydney, Australia.
10. Barret, Z., Yuret, D., May, J., and Knight, K. (2016). Transfer learning for low-resource neural machine translation. arXiv.
11. Min, T. (2020). Research on Neural Machine Translation under Low-Resource Conditions, Soochow University.
12. English-Chinese Machine Translation Based on Transfer Learning and Chinese-English Corpus10.1155/2022/1563731 ↗
13. Short Sequence Chinese-English Machine Translation Based on Generative Adversarial Networks of Emotion
14. A Study on Chinese-English Machine Translation Based on Migration Learning and Neural Networks10.1142/S0218213022500312 ↗
15. A Study on Chinese-English Machine Translation Based on Transfer Learning and Neural Networks
16. Kurosawa, M., and Komachi, M. (2019). Dynamic Fusion: Attentional Language Model for Neural Machine Translation. arXiv.10.1007/978-981-15-6168-9_9 ↗
17. Multisensor Feature Fusion-Based Model for Business English Translation
18. A System Fusion Method for Neural Machine Translation
19. Assembling Translations from Multi-Engine Machine Translation Outputs10.1016/j.asoc.2019.02.031 ↗
20. Zoph, B., and Knight, K. (2016, January 12–17). Multi-Source Neural Translation. Proceedings of the Paper Presented at the 15th Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2016, San Diego, CA, USA.10.18653/v1/N16-1004 ↗
21. Statistical-Based System Combination Approach to Gain Advantages over Different Machine Translation Systems10.1016/j.heliyon.2019.e02504 ↗
22. Zhou, L., Zhang, J., Zong, C., and Yu, H. (2019). Sequence Generation: From Both Sides to the Middle. arXiv.10.24963/ijcai.2019/760 ↗
23. Sreedhar, M.N., Wan, X., Cheng, Y., and Hu, J. (2022). Local Byte Fusion for Neural Machine Translation. arXiv.
24. Wang, Q., Li, F., Xiao, T., Li, Y., Li, Y., and Zhu, J. (2020). Multi-Layer Representation Fusion for Neural Machine Translation. arXiv.
25. Vaswani, A., Shazeer, N.M., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv.
26. Research Review of Pre-training Technology Based on Language Model
27. He, K., Zhang, X., Ren, S., and Sun, J. Deep Residual Learning for Image Recognition. In Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2015, Las Vegas, NV, USA, 27–30 June 2016.10.1109/CVPR.2016.90 ↗
28. Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018, January 1–6). Deep Contextualized Word Representations. Proceedings of the Paper Presented at the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT 2018, New Orleans, LA, USA.10.18653/v1/N18-1202 ↗
29. Bimal, K. (2001). Modern Power Electronics and AC Drives, Prentice-Hall.
30. Wang, C., Zhao, J., Yu, Q., and Cheng, H. (2005). Modern Power Electronics and AC Drive, Machinery Industry Press.
31. Wang, Q., and Glover, J.D. (2009). Power System Analysis and Design (Adapted in English), Machinery Industry Press.
32. Wang, Q., Huang, W., Yan, Y., and Ma, Y. (2015). Power System Analysis and Design (Chinese Edition), Machinery Industry Press.
33. Klein, G., Kim, Y., Deng, Y., Senellart, J., and Rush, A.M. (2017). Opennmt: Open-Source Toolkit for Neural Machine Translation. arXiv.10.18653/v1/P17-4012 ↗
34. Papineni, K., Roukos, S., Ward, T., and Zhu, W.-J. (2002, January 6–12). Bleu: A method for automatic evaluation of machine translation. Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Association for Computational Linguistics (2002), Philadelphia, PA, USA.10.3115/1073083.1073135 ↗