Ancient character detection based on fine-grained density map
Source abstract
Abstract
Ancient character detection is a crucial step for automatic recognition and digital library management. However, inscriptions on ancient artifacts vary in size and are sparsely distributed, challenging the detection of small characters with complex noise. This paper proposes a Fine-grained Density Map (FDM)-based method for ancient character detection. We design a semantic-based density map generation network to locate characters, crop the original image based on the density map, and fuse the detection results of cropped images with the original image. In addition, we propose a non-maximum suppression filtering strategy based on a density map (NMS-DM) to utilize the location information from the density map. Compared with the baseline, our method improves F1-score and recall by 2.16% and 6.10% respectively, while also improving precision and recall on small characters by 2.20% each. Our method can improve detection performance, especially for ancient scripts with complex background noise and numerous small characters.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Handwritten Text Recognition Techniques · Image Processing and 3D Reconstruction · Advanced Image and Video Retrieval Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. Gao, J. & Liang, X. Distinguishing oracle variants based on the isomorphism and symmetry invariances of oracle-bone inscriptions. IEEE Access 8, 152258–152275 (2020).10.1109/ACCESS.2020.3017533 ↗
2. Jiao, Q. et al. Module structure detection of oracle characters with similar semantics. Alex. Eng. J. 60, 4819–4828 (2021).10.1016/j.aej.2021.03.072 ↗
3. Li, J. et al. A comprehensive survey of oracle character recognition: challenges, benchmarks, and beyond. arXiv preprint arXiv:2411.11354, (2024).10.2139/ssrn.5081652 ↗
4. Yuan, J. et al. R-gnn: recurrent graph neural networks for font classification of oracle bone inscriptions. Herit. Sci. 12, 30 (2024).10.1186/s40494-024-01133-4 ↗
5. Liu, G. et al. Gca-pvt-net: group convolutional attention and pvt dual-branch network for oracle bone drill chisel segmentation. Herit. Sci. 12, 260 (2024).10.1186/s40494-024-01378-z ↗
6. Qiao, R., Yang, L., Pang, K. & Zhang, H. Making visual sense of oracle bones for you and me. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 12656–12665 (2024).10.1109/CVPR52733.2024.01203 ↗
7. Diao, X. et al. bibinfotitleToward zero-shot character recognition: A gold standard dataset with radical-level annotations. In Proceedings of the 31st ACM International Conference on Multimedia, 6869–6877 (2023).10.1145/3581783.3612201 ↗
8. Diao, X. et al. Rzcr: Zero-shot character recognition via radical-based reasoning. In Proceedings of the 32nd International Joint Conference on Artificial Intelligence (IJCAI) (2023).10.24963/ijcai.2023/73 ↗
9. Flad, R. K. Divination and power: A multiregional view of the development of oracle bone divination in early china. Cur. Anthropol. World J. Sci. Man 49, 403–437 (2008).10.1086/588495 ↗
10. Chi, Y. et al. Zinet: Linking chinese characters spanning three thousand years. In Findings of the Association for Computational Linguistics: ACL 2022, 3061–3070 (2022).10.18653/v1/2022.findings-acl.242 ↗
11. Ross, T.-Y. & Dollár, G. Focal loss for dense object detection. In Proceedings of the IEEE Conference On Computer Vision and Pattern Recognition, 2980–2988 (2017).
12. Redmon, J. You only look once: Unified, real-time object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016).10.1109/CVPR.2016.91 ↗
13. Wei, W., Cheng, Y., He, J. & Zhu, X. A review of small object detection based on deep learning. Neural Comput. Appl. 36, 6283–6303 (2024).10.1007/s00521-024-09422-6 ↗
14. Xuzheng, L., Hengjin, C. & Li, L. Recognition of oracle radical based on the capsule network. CAAI Trans. Intell. Syst. 15, 243–254 (2020).
15. Meng, L. et al. Oracle bone inscription detector based on SSD. In New Trends in Image Analysis and Processing–ICIAP 2019: ICIAP International Workshops, BioFor, PatReCH, e-BADLE, DeepRetail, and Industrial Session, Trento, Italy, September 9–10, 2019, Revised Selected Papers 20, 126–136 (Springer, 2019).10.1007/978-3-030-30754-7_13 ↗
16. Xing, J., Liu, G. & Xiong, J. Oracle bone inscription detection: a survey of oracle bone inscription detection based on deep learning algorithm. In Proceedings of the International Conference on Artificial Intelligence, Information Processing and Cloud Computing, 1–8 (2019).10.1145/3371425.3371434 ↗
17. Duan, K. et al. Centernet: Keypoint triplets for object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 6569–6578 (2019).10.1109/ICCV.2019.00667 ↗
18. Liu, G., Chen, S., Xiong, J. & Jiao, Q. An oracle bone inscription detector based on multi-scale Gaussian kernels. Appl. Math. 12, 224–239 (2021).10.4236/am.2021.123014 ↗
19. Fu, X., Zhou, R., Yang, X. & Li, C. Detecting oracle bone inscriptions via pseudo-category labels. Herit. Sci. 12, 107 (2024).10.1186/s40494-024-01221-5 ↗
20. Zhen, Q., Wu, L. & Liu, G. An oracle bone inscriptions detection algorithm based on improved YOLOv8. Algorithms 17, 174 (2024).10.3390/a17050174 ↗
21. Hu, Z., Cheung, Y.-m., Zhang, Y., Zhang, P. & Tang, P.-l. Component-level oracle bone inscription retrieval. In Proceedings of the 2024 International Conference on Multimedia Retrieval, 647–656 (2024).10.1145/3652583.3658116 ↗
22. Zhang, G., Liu, D., Smyth, B. & Dong, R. Deciphering ancient Chinese oracle bone inscriptions using case-based reasoning. In International Conference on Case-Based Reasoning, 309–324 (Springer, 2021).10.1007/978-3-030-86957-1_21 ↗
23. Xu, Y. et al. Conf-unet: A model for speculation on unknown oracle bone characters. In International Conference on Knowledge Science, Engineering and Management, 89–103 (Springer, 2023).10.1007/978-3-031-40286-9_9 ↗
24. Jiang, R. et al. Oraclepoints: A hybrid neural representation for oracle character. In Proceedings of the 31st ACM International Conference on Multimedia, 7901–7911 (2023).10.1145/3581783.3612534 ↗
25. Shi, D. et al. Charformer: A glyph fusion based attentive framework for high-precision character image denoising. In Proceedings of the 30th ACM International Conference on Multimedia, 1147–1155 (2022).10.1145/3503161.3548208 ↗
26. Shi, D. et al. Rcrn: Real-world character image restoration network via skeleton extraction. In Proceedings of the 30th ACM International Conference on Multimedia, 1177–1185 (2022).10.1145/3503161.3548344 ↗
27. Li, C., Yang, T., Zhu, S., Chen, C. & Guan, S. Density map guided object detection in aerial images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 190–191 (2020).10.1109/CVPRW50498.2020.00103 ↗
28. Duan, C., Wei, Z., Zhang, C., Qu, S. & Wang, H. Coarse-grained density map guided object detection in aerial images. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 2789–2798 (2021).10.1109/ICCVW54120.2021.00313 ↗
29. Ren, S., He, K., Girshick, R. & Sun, J. Faster r-cnn: Towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39, 1137–1149 (2016).10.1109/TPAMI.2016.2577031 ↗
30. Ranjan, V., Sharma, U., Nguyen, T. & Hoai, M. Learning to count everything. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3394–3403 (2021).10.1109/CVPR46437.2021.00340 ↗
31. Liu, L. et al. Cross-modal collaborative representation learning and a large-scale RGBT benchmark for crowd counting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 4823–4833 (2021).10.1109/CVPR46437.2021.00479 ↗
32. Xu, J., Le, H., Nguyen, V., Ranjan, V. & Samaras, D. Zero-shot object counting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 15548–15557 (2023).10.1109/CVPR52729.2023.01492 ↗
33. Arteta, C., Lempitsky, V. & Zisserman, A. Counting in the wild. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII 14, 483–498 (Springer, 2016).10.1007/978-3-319-46478-7_30 ↗
34. Mundhenk, T. N., Konjevod, G., Sakla, W. A. & Boakye, K. A large contextual dataset for classification, detection and counting of cars with deep learning. In Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part III 14, 785–800 (Springer, 2016).10.1007/978-3-319-46487-9_48 ↗
35. Zhang, Y., Zhou, D., Chen, S., Gao, S. & Ma, Y. Single-image crowd counting via multi-column convolutional neural network. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 589–597 (2016).10.1109/CVPR.2016.70 ↗
36. Li, Y., Zhang, X. & Chen, D. Csrnet: Dilated convolutional neural networks for understanding the highly congested scenes. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1091–1100 (2018).10.1109/CVPR.2018.00120 ↗
37. Zhai, Y. et al. Cas-net: Comparison-based attention siamese network for change detection with an open high-resolution UAV image dataset. IEEE Transactions on Geoscience and Remote Sensing (2024).10.1109/TGRS.2024.3386918 ↗
38. Lin, H., Ma, Z., Ji, R., Wang, Y. & Hong, X. Boosting crowd counting via multifaceted attention. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 19628–19637 (2022).10.1109/CVPR52688.2022.01901 ↗
39. Jiang, R., Liu, L. & Chen, C. Clip-count: Towards text-guided zero-shot object counting. In Proceedings of the 31st ACM International Conference on Multimedia, 4535–4545 (2023).10.1145/3581783.3611789 ↗
40. He, K., Zhang, X., Ren, S. & Sun, J. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 770–778 (2016).10.1109/CVPR.2016.90 ↗
41. Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 84–90 (2017).10.1145/3065386 ↗
42. Wang, C.-Y., Bochkovskiy, A. & Liao, H.-Y. M. Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision And Pattern Recognition, 7464–7475 (2023).10.1109/CVPR52729.2023.00721 ↗
43. Li, B. et al. Oracle bone inscriptions multi-modal dataset. arXiv preprint arXiv:2407.03900 (2024).
44. Lin, T. Y., Maire, M., Belongie, S., Hays, J. & Zitnick, C. L. Microsoft Coco: Common objects in context. In European Conference on Computer Vision (2014).10.1007/978-3-319-10602-1_48 ↗
45. Lin, G., Milan, A., Shen, C. & Reid, I. Refinenet: Multi-path refinement networks for high-resolution semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1925–1934 (2017).10.1109/CVPR.2017.549 ↗
46. Swathi, Y. & Challa, M. Yolov8: advancements and innovations in object detection. In International Conference on Smart Computing and Communication, 1–13 (Springer, 2024).10.1007/978-981-97-1323-3_1 ↗
47. Khanam, R. & Hussain, M. Yolov11: An overview of the key architectural enhancements. https://doi.org/10.48550/arXiv.2410.17725 (2024).10.48550/arXiv.2410.17725 ↗