Automatic Receipt Recognition System Based on Artificial Intelligence Technology
Source abstract
Abstract
In this study, an automatic receipt recognition system (ARRS) is developed. First, a receipt is scanned for conversion into a high-resolution image. Receipt characters are automatically placed into two categories according to the receipt characteristics: printed and handwritten characters. Images of receipts with these characters are preprocessed separately. For handwritten characters, template matching and the fixed features of the receipts are used for text positioning, and projection is applied for character segmentation. Finally, a convolutional neural network is used for character recognition. For printed characters, a modified You Only Look Once (version 4) model (YOLOv4-s) executes precise text positioning and character recognition. The proposed YOLOv4-s model reduces downsampling, thereby enhancing small-object recognition. Finally, the system produces recognition results in a tax declaration format, which can upload to a tax declaration system. Experimental results revealed that the recognition accuracy of the proposed system was 80.93% for handwritten characters. Moreover, the YOLOv4-s model had a 99.39% accuracy rate for printed characters; only 33 characters were misjudged. The recognition accuracy of the YOLOv4-s model was higher than that of the traditional YOLOv4 model by 20.57%. Therefore, the proposed ARRS can considerably improve the efficiency of tax declaration, reduce labor costs, and simplify operating procedures.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Vehicle License Plate Recognition · Handwritten Text Recognition Techniques · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Information Engineering, National Chin-Yi University of Technology, Taichung 411, Taiwan
College of Intelligence, National Taichung University of Science and Technology, Taichung 404, Taiwan
Department of International Business, National Taichung University of Science and Technology, Taichung 404, Taiwan
References (20)
Show source-provided references
1. Rahmat, R.F., Gunawan, D., Faza, S., Haloho, N., and Nababan, E.B. (2018, January 17–18). Android-based text recognition on receipt bill for tax sampling system. Proceedings of the 2018 Third International Conference on Informatics and Computing (ICIC), Palembang, Indonesia.10.1109/IAC.2018.8780416 ↗
2. Laroca, R., Severo, E., Zanlorensi, L.A., Oliveira, L.S., Gonçalves, G.R., Schwartz, W.R., and Menotti, D. (2018, January 8–13). A robust real-time automatic license plate recognition based on the YOLO detector. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.10.1109/IJCNN.2018.8489629 ↗
3. Liu, W., Yuan, X., Zhang, Y., Liu, M., Xiao, Z., and Wu, J. (2020, January 12–14). An end to end method for taxi receipt automatic recognition based on neural network. Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China.10.1109/ITNEC48623.2020.9084712 ↗
4. Shi, S., Cui, C., and Xiao, Y. (2020, January 11–13). An invoice recognition system using deep learnin. Proceedings of the 2020 International Conference on Intelligent Computing, Automation and Systems (ICICAS), Chongqing, China.10.1109/ICICAS51530.2020.00093 ↗
5. IRIS: Smart phone aided intelligent reimbursement system using deep learning10.1109/ACCESS.2019.2953501 ↗
6. Gabor filters-based feature extraction for character recognition10.1016/j.patcog.2004.08.004 ↗
7. Cui, L., and Ruan, Q. (September, January 31). A novel SVM classifier for recognition of gray character using gabor filters. Proceedings of the 7th International Conference on Signal Processing, (ICSP’04), Beijing, China.
8. Xie, J. (2009, January 21–22). Optical character recognition based on least square support vector machine. Proceedings of the 2009 Third International Symposium on Intelligent Information Technology Application, Nanchang, China.10.1109/IITA.2009.327 ↗
9. Hazra, T.K., Singh, D.P., and Daga, N. (2017, January 16–18). Optical character recognition using KNN on custom image dataset. Proceedings of the 2017 8th Annual Industrial Automation and Electromechanical Engineering Conference (IEMECON), Bangkok, Thailand.10.1109/IEMECON.2017.8079572 ↗
10. Smith, R. (2007, January 23–26). An overview of the tesseract OCR engine. Proceedings of the Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), Curitiba, Brazil.10.1109/ICDAR.2007.4376991 ↗
11. Liu, W., Yuan, X., Zhang, Y., Wu, M., Du, H., and Cui, Y. (2020, January 27–29). An automatic taxi receipt text recognition application system. Proceedings of the 2020 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB), Paris, France.10.1109/BMSB49480.2020.9379905 ↗
12. Dong, X., and Colleen, P.B. (2020, January 22). Novel receipt recognition with deep learning algorithms. Proceedings of the SPIE, Online.
13. Liu, Y.C. (2019). Handwritten Invoice Recognition System Using Deep Learning. [Master’s Thesis, National Taiwan Ocean University].
14. Nguyen, C.M., Ngo, V.V., and Nguyen, D.D. (2021, January 19–21). MC-OCR Challenge 2021: Simple approach for receipt information extraction and quality evaluation. Proceedings of the 2021 RIVF International Conference on Computing and Communication Technologies (RIVF), Hanoi, Vietnam.10.1109/RIVF51545.2021.9642150 ↗
15. Level set based segmentation using local fitted images and inhomogeneity entropy10.1016/j.sigpro.2019.107297 ↗
16. Bradski, G. (2021, December 02). The OpenCV Library. Dr. Dobb’s Journal of Software Tools. Available online: https://www.bibsonomy.org/user/ross_mck.
17. An improved color image defogging algorithm using dark channel model and enhancing saturation10.1016/j.ijleo.2018.12.020 ↗
18. Zhang, J., Ren, F., Ni, H., Zhang, Z., and Wang, K. (2019, January 19–21). Research on information recognition of VAT invoice based on computer vision. Proceedings of the 2019 IEEE 6th International Conference on Cloud Computing and Intelligence Systems (CCIS), Singapore.10.1109/CCIS48116.2019.9073749 ↗
19. Mansoor, K., and Olson, C.F. (2019, January 2–4). Recognizing text with a CNN. Proceedings of the 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ), Dunedin, New Zealand.10.1109/IVCNZ48456.2019.8961031 ↗
20. Wu, M., Zhang, W., Han, Y., and Mao, Y. (2021, January 26–28). Rapid temporal information identification in paper worksheets using light-weight convolutional neural networks. Proceedings of the 2021 40th Chinese Control Conference (CCC), Shanghai, China.10.23919/CCC52363.2021.9549764 ↗