An Improved LSTM-Based Failure Classification Model for Financial Companies Using Natural Language Processing
Source abstract
Abstract
The Korean e-commerce market represents a large percentage of the global retail distribution market, a market that continues to grow each year, and online payments are rapidly becoming a mainstream payment method. As e-commerce becomes more active, many companies that support electronic payments are increasing the number of franchisees. Electronic payments have become an indispensable part of people’s lives. However, the types of statistical information on the results of electronic payment transactions are not consistent across companies, and it is difficult to automatically determine the error status of a transaction if no one directly confirms the error messages generated during payment. To address these issues, we propose an optimized LSTM model. In this study, we classify the error content in statistical information based on natural language processing to determine the error status of the current failed transaction. We collected 11,865 response messages from various vendors and financial companies and labelled them with an LSTM classifier model to create a dataset. We then trained this dataset with simple RNN, LSTM, and GRU models and compared their performance. The results show that the optimized LSTM model with the attention layer added to the dropout layer and the bidirectional recursive layer achieves an accuracy of about 92% or more. When the model is applied to e-commerce services, any error in the transaction status of the system can be automatically detected by the model.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Technology and Data Analysis · Imbalanced Data Classification Techniques · Innovation in Digital Healthcare Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Science, Hanyang University, Seoul 04763, Republic of Korea
Funding
Institute of Information & Communications Technology Planning & Evaluation (IITP)
References (20)
Show source-provided references
1. Yunhap News Agency (2021, May 03). United Nations, Increases E-Commerce Due to COVID-19…Korea’s Largest Portion of the Survey Subjects. Available online: https://www.yna.co.kr/view/AKR20210503145200088.
2. Tobias, E.S., and Demuth, W. (2020, January 22–24). Leveraging Clustering and Natural Language Processing to Overcome Variety Issues in Log Management. Proceedings of the 12th International Conference on Agents and Artificial Intelligence (ICAART 2020), Valletta, Malta. Available online: https://www.scitepress.org/Papers/2020/88566/88566.pdf.
3. Finding structure in time10.1207/s15516709cog1402_1 ↗
4. Long short-term memory
5. Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv.
6. Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., and Shroff, G. (2016). LSTM-based encoder-decoder for multi-sensor anomaly detection. arXiv.
7. Zhang, Y., Liu, Q., and Song, L. (2018). Sentence-state lstm for text representation. arXiv.10.18653/v1/P18-1030 ↗
8. LSTM2: Multi-Label Ranking for Document Classification10.1007/s11063-017-9636-0 ↗
9. Credit card fraud detection using machine learning algorithms10.1016/j.procs.2020.01.057 ↗
10. Financial fraud detection in healthcare using machine learning and deep learning techniques10.1155/2021/9293877 ↗
11. Raghavan, P., and El Gayar, N. (2019, January 11–12). Fraud detection using machine learning and deep learning. Proceedings of the 2019 International Conference on Computational Intelligence and Knowledge Economy (ICCIKE), Dubai, United Arab Emirates.10.1109/ICCIKE47802.2019.9004231 ↗
12. (2022, July 28). TensorFlow Addons Optimizers: CyclicalLearningRate. Available online: https://www.tensorflow.org/addons/tutorials/optimizers_cyclicallearningrate.
13. Smith, L.N. (2017, January 24–31). Cyclical learning rates for training neural networks. Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA.10.1109/WACV.2017.58 ↗
14. Hinton, G.E., Srivastava, N., Krizhevsky, A., Sutskever, I., and Salakhutdinov, R.R. (2012). Improving neural networks by preventing co-adaptation of feature detectors. arXiv.
15. Bidirectional recurrent neural networks10.1109/78.650093 ↗
16. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv.
17. A new method for analysis of Multi-State systems based on Multi-valued decision diagram under epistemic uncertainty10.1016/j.ress.2022.108868 ↗
18. Combinatorial Reliability Evaluation of Multi-State System with Epistemic Uncertainty
19. An effective evidence theory-based reliability analysis algorithm for structures with epistemic uncertainty10.1002/qre.2767 ↗
20. Enhanced reliability analysis method for multistate systems with epistemic uncertainty based on evidential network10.1002/qre.2735 ↗