journal article·2025-12-18

Dual-Path Global Awareness Transformer for Optical Chemical Structure Recognition

Rui Wang, Yujin Ji, Youyong Li, Shuit-Tong Lee

Publisher page

Abstract

Optical chemical structure recognition (OCSR), reconstructing structural information from chemical graphics into machine-readable sequences, has recently emerged as a focal research topic at the intersection of materials science and computer science. Existing multimodal fusion methods possess limited awareness of global context and often produce erroneous sequences when encountering complex motifs, such as rings or long chains. To address this issue, we propose the dual-path global awareness transformer (DGAT) for sequence generation. Its cascaded global feature enhancement (CGFE) module emphasizes global context and bridges cross-modal gaps, while the sparse differential global-local attention (SDGLA) module dynamically captures fine-grained differences between global and local features. We have constructed a new evaluation data set, and DGAT achieves state-of-the-art (SOTA) performance, reaching BLEU-4 = 0.840 (+5.3%), ROUGE-L = 0.908 (+1.9%), and mean Tanimoto similarity = 0.988 (+1.2%) over the best published model, confirming its ability to generate sequences that are both symbolically accurate and chemically precise.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Machine Learning in Materials Science · Computational Drug Discovery Methods · Machine Learning in Bioinformatics

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Macao Institute of Materials Science and Engineering, Faculty of Innovation Engineering

Macau University of Science and Technology

State Key Laboratory of Bioinspired Interfacial Materials Science, Institute of Functional Nano and Soft Materials (FUNSOM)

Soochow University

Funding

Collaborative Innovation Center of Suzhou Nano Science and Technology · National Key Research and Development Program of China · Fundo para o Desenvolvimento das Ci?ncias e da Tecnologia · National Natural Science Foundation of China · Higher Education Discipline Innovation Project

References (39)

Show source-provided references
1. 10.1021/ci800067r10.1021/ci800067r ↗
2. Peryea, T.; Katzel, D.; Zhao, T.; Southall, N.; Nguyen, D.T.; et al. MOLVEC: Open Source Library for Chemical Structure Recognition. Proceedings of the American Chemical Society’s Fall 2019 National Meeting & Exposition ; San Diego, CA, Aug 22–29, 2019.
3. 10.1021/ci800449t10.1021/ci800449t ↗
4. 10.48550/arXiv.1706.0376210.48550/arXiv.1706.03762 ↗
5. 10.1109/JBHI.2024.335007710.1109/JBHI.2024.3350077 ↗
6. 10.26599/CVM.2025.945044910.26599/CVM.2025.9450449 ↗
7. 10.1109/TMI.2024.350707310.1109/TMI.2024.3507073 ↗
8. 10.1016/j.bspc.2023.10574210.1016/j.bspc.2023.105742 ↗
9. 10.1021/acs.jcim.0c0045910.1021/acs.jcim.0c00459 ↗
10. 10.1021/acs.jcim.2c0073310.1021/acs.jcim.2c00733 ↗
11. 10.1093/bib/bbac03310.1093/bib/bbac033 ↗
12. Sandler, M.; Howard, A.; Zhu, M.; et al. MobileNetV2: Inverted Residuals and Linear Bottlenecks. Proceedings of the 2018 IEEE Conference on Computer Vision and Pattern Recognition ; Salt Lake City, UT, June 18–23, 2018;10.1109/CVPR.2018.00474.10.1109/CVPR.2018.00474 ↗
13. Jocher, G.; et al. ultralytics/yolov5: v5.0 - YOLOv5-P6 1280 Models, AWS, Supervise.ly and YouTube Integrations ; Zenodo: Geneva, Switzerland, 2021;10.5281/zenodo.4679653.10.5281/zenodo.4679653 ↗
14. 10.1145/361759210.1145/3617592 ↗
15. 10.1016/j.neucom.2024.12782310.1016/j.neucom.2024.127823 ↗
16. 10.1016/j.engappai.2024.10928810.1016/j.engappai.2024.109288 ↗
17. 10.1039/D1SC01839F10.1039/D1SC01839F ↗
18. 10.1002/cmtd.20210006910.1002/cmtd.202100069 ↗
19. He, K.; Zhang, X.; Ren, S. Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) ; Las Vegas, NV, June 27–30, 2016;10.1109/CVPR.2016.90.10.1109/CVPR.2016.90 ↗
20. 10.1186/s13321-021-00538-810.1186/s13321-021-00538-8 ↗
21. 10.1038/s41467-023-40782-010.1038/s41467-023-40782-0 ↗
22. 10.48550/arXiv.1905.1194610.48550/arXiv.1905.11946 ↗
23. 10.1109/ICML.2021.1009610.1109/ICML.2021.10096 ↗
24. 10.14135/j.cnki.1006-3080.2021091600210.14135/j.cnki.1006-3080.20210916002 ↗
25. 10.48550/arXiv.2004.0895510.48550/arXiv.2004.08955 ↗
26. 10.1186/s13321-022-00624-510.1186/s13321-022-00624-5 ↗
27. Liu, Z.; Lin, Y.; Cao, Y.; Hu, H.; Wei, Y.; Zhang, Z.; Lin, S.; Guo, B. Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision (ICCV) ; Montreal, Quebec, Canada, Oct 10–17, 2021;10.1109/iccv48922.2021.00986.10.1109/iccv48922.2021.00986 ↗
28. 10.1007/s40747-024-01561-610.1007/s40747-024-01561-6 ↗
29. 10.1109/CVPR52688.2022.0071410.1109/CVPR52688.2022.00714 ↗
30. 10.1093/nar/gkaa97110.1093/nar/gkaa971 ↗
31. 10.1186/s13321-017-0220-410.1186/s13321-017-0220-4 ↗
32. Landrum, G. RDKit: A Software Suite for Cheminformatics, Computational Chemistry, and Predictive Modeling ; RDKit: San Diego, CA, 2013; https://www.rdkit.org (accessed Sept 21, 2025).
33. 10.3115/1073083.107313510.3115/1073083.1073135 ↗
34. Lin, C. Y. ROUGE: A Package for Automatic Evaluation of Summaries. Text Summarization Branches Out ; Association for Computational Linguistics: Barcelona, Spain, 2004, Vol. 1, pp 74–81, https://aclanthology.org/W04-1013/ (accessed Sept 21, 2025).
35. 10.1186/s13321-015-0069-310.1186/s13321-015-0069-3 ↗
36. 10.48550/arXiv.2410.2127610.48550/arXiv.2410.21276 ↗
37. OpenAI. Introducing OpenAI o3 and o4-mini ; OpenAI: San Francisco, CA, May 27, 2025; https://openai.com/index/introducing-o3-and-o4-mini/ (accessed Sept 21, 2025).
38. 10.48550/arXiv.2412.1943710.48550/arXiv.2412.19437 ↗
39. 10.1038/s41586-025-09422-z10.1038/s41586-025-09422-z ↗