AttenFlow: Context-Aware Architecture with Consensus-Based Retrieval and Graph Attention for Automated Document Processing
Source abstract
Abstract
Automated document processing and circulation systems face critical challenges in achieving reliable retrieval accuracy and robust classification performance, particularly in security-critical organizational environments. Traditional approaches suffer from fundamental limitations, including fixed fusion strategies in hybrid retrieval systems, inability to model inter-document relationships in classification tasks, and lack of confidence estimation for result reliability. This paper introduces AttenFlow, a novel context-aware architecture that revolutionizes document management through two core technical innovations. First, we propose the retriever consensus confidence fusion (RCCF) method, which addresses the limitations of conventional hybrid retrieval approaches by introducing consensus-based fusion strategies that dynamically adapt to retriever agreement levels while providing confidence estimates for results. RCCF measures the consensus between different retrievers through sophisticated ranking and scoring consistency metrics, enabling adaptive weight assignment that amplifies high-consensus results while adopting conservative approaches for uncertain cases. Second, we develop adversarial mutual-attention hybrid-dimensional graph attention network (AM-HDGAT) for text, which transforms document classification by modeling inter-document relationships through graph structures while integrating high-dimensional semantic features and low-dimensional statistical features through mutual-attention mechanisms. The approach incorporates adversarial training to enhance robustness against potential security threats, making it particularly suitable for critical document processing applications. Comprehensive experimental evaluation across multiple benchmark datasets demonstrates the substantial effectiveness of our innovations. RCCF achieves improvements of up to 16.9% in retrieval performance metrics compared to traditional fusion methods while providing reliable confidence estimates. AM-HDGAT for text demonstrates superior classification performance with an average F1-score improvement of 2.23% compared to state-of-the-art methods, maintaining 82.4% performance retention under adversarial attack scenarios. Real-world deployment validation shows a 34.5% reduction in manual processing time and 95.7% user satisfaction scores, establishing AttenFlow as a significant advancement in intelligent document management technology.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Service-Oriented Architecture and Web Services · Semantic Web and Ontologies · Business Process Modeling and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electronic Engineering, Naval University of Engineering, Wuhan 430068, China
References (41)
Show source-provided references
1. Madison, D. (2005). Process Mapping, Process Improvement, and Process Management: A Practical Guide for Enhancing Work and Information Flow, Paton Professional.
2. Abbas, S.W., Hamid, M., Alkanhel, R., and Abdallah, H.A. (2023). Official Statistics and Big Data Processing with Artificial Intelligence: Capacity Indicators for Public Sector Organizations. Systems, 11.10.3390/systems11080424 ↗
3. National–Cultural Adjustment of the Text of Official Communication
4. Ziemba, E., Papaj, T., and Descours, D. (2022, January 4–7). Critical success factors for adopting electronic document management systems in government units. Proceedings of the 2022 17th Conference on Computer Science and Intelligence Systems (FedCSIS), Sofia, Bulgaria.
5. A blockchain-based integrated document management framework for construction applications10.1016/j.autcon.2021.104001 ↗
6. Di Marzo Serugendo, G., Cappelli, M.A., Falquet, G., Métral, C., Wade, A., Ghadfi, S., Cutting-Decelle, A.F., Caselli, A., and Cutting, G. (2024). Streamlining Tax and Administrative Document Management with AI-Powered Intelligent Document Management System. Information, 15.10.3390/info15080461 ↗
7. How do machine learning, robotic process automation, and blockchains affect the human factor in business process management?
8. Robotic process automation10.1007/s12525-019-00365-8 ↗
9. The impact of document management using good practices: A literature review
10. Development of intelligent electronic document management system model based on machine learning methods
11. Guo, J., Fan, Y., Ai, Q., and Croft, W.B. (2016, January 24–28). A Deep Relevance Matching Model for Ad-hoc Retrieval. Proceedings of the 25th ACM International on Conference on Information and Knowledge Management, Indianapolis, IN, USA.10.1145/2983323.2983769 ↗
12. Karpukhin, V., Oğuz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D., and Yih, W.T. (2020). Dense Passage Retrieval for Open-Domain Question Answering. arXiv.10.18653/v1/2020.emnlp-main.550 ↗
13. Lin, J., Nogueira, R., and Yates, A. (2021). Pretrained Transformers for Text Ranking: BERT and Beyond. arXiv.10.1007/978-3-031-02181-7 ↗
14. Cormack, G.V., Clarke, C.L.A., and Buettcher, S. (2009, January 19–23). Reciprocal rank fusion outperforms condorcet and individual rank learning methods. Proceedings of the 32nd International ACM SIGIR Conference on Research and Development in Information Retrieval, Boston, MA, USA.10.1145/1571941.1572114 ↗
15. Chen, Y. (2015). Convolutional Neural Network for Sentence Classification. [Master’s Thesis, University of Waterloo].
16. Das, M., and Alphonse, P. (2023). A comparative study on tf-idf feature weighting method and its analysis using unstructured dataset. arXiv.
17. Roul, R.K., Devanand, O.R., and Sahay, S.K. (2014). Web document clustering and ranking using tf-idf based apriori approach. arXiv.
18. Modeling of the electronic document circulation and record keeping system in the processes of cargo transportation in railway transport10.1051/e3sconf/202345803002 ↗
19. Abualigah, L.M.Q. (2019). Feature Selection and Enhanced Krill Herd Algorithm for Text Document Clustering, Springer.10.1007/978-3-030-10674-4 ↗
20. Visformers—Combining vision and transformers for enhanced complex document classification10.3390/make6010023 ↗
21. Efficient automated processing of the unstructured documents using artificial intelligence: A systematic literature review and future directions10.1109/ACCESS.2021.3072900 ↗
22. Bezdan, T., Stoean, C., Naamany, A.A., Bacanin, N., Rashid, T.A., Zivkovic, M., and Venkatachalam, K. (2021). Hybrid fruit-fly optimization algorithm with k-means for text document clustering. Mathematics, 9.10.3390/math9161929 ↗
23. Abualigah, L., Gandomi, A.H., Elaziz, M.A., Hamad, H.A., Omari, M., Alshinwan, M., and Khasawneh, A.M. (2021). Advances in meta-heuristic optimization algorithms in big data text clustering. Electronics, 10.10.3390/electronics10020101 ↗
24. A blockchain-based land title management system for Bangladesh10.1016/j.jksuci.2020.10.011 ↗
25. The process of electronic document management in the system of railway automation and telemechanics
26. Design and implementation of a web-based document management system
27. Represa, J.G., Larrinaga, F., Varga, P., Ochoa, W., Perez, A., Kozma, D., and Delsing, J. (2023). Investigation of microservice-based workflow management solutions for industrial automation. Appl. Sci., 13.10.3390/app13031835 ↗
28. Attention is all you need
29. Attention in Natural Language Processing10.1109/TNNLS.2020.3019893 ↗
30. Abreu, J., Fred, L., Macêdo, D., and Zanchettin, C. (2019, January 17–19). Hierarchical attentional hybrid neural networks for document classification. Proceedings of the International Conference on Artificial Neural Networks, Munich, Germany.10.1007/978-3-030-30493-5_39 ↗
31. Huang, W., Lin, M., and Wang, Y. (2022). Sentiment analysis of Chinese e-commerce product reviews using ERNIE word embedding and attention mechanism. Appl. Sci., 12.10.3390/app12147182 ↗
32. Attention-based contextual local and global features for urgent posts classification in MOOCs discussion forums10.1016/j.asej.2023.102605 ↗
33. Karimi, M., and Barfroush, A.A. (2023). Proposing a Dynamic Executive Microservices Architecture Model for AI Systems. arXiv.
34. Deep Learning for Technical Document Classification10.1109/TEM.2022.3152216 ↗
35. Omar Khattab, M.Z. (2020). ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERT. arXiv.10.1145/3397271.3401075 ↗
36. Xiong, L., Xiong, C., Li, Y., Tang, K.F., Liu, J., Bennett, P., Ahmed, J., and Overwijk, A. (2020). Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrieval. arXiv.
37. Benham, R., and Culpepper, J.S. (2017, January 7–8). Risk-Reward Trade-offs in Rank Fusion. Proceedings of the 22nd Australasian Document Computing Symposium, Brisbane, QLD, Australia. ADCS ’17.10.1145/3166072.3166084 ↗
38. Voorhees, E., Alam, T., Bedrick, S., Demner-Fushman, D., Hersh, W.R., Lo, K., Roberts, K., Soboroff, I., and Wang, L.L. (2020). TREC-COVID: Constructing a Pandemic Information Retrieval Test Collection. arXiv.10.1145/3451964.3451965 ↗
39. Thakur, N., Reimers, N., Rücklé, A., Srivastava, A., and Gurevych, I. (2021, January 6–14). BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models. Proceedings of the 2021 Conference on Neural Information Processing Systems Datasets and Benchmarks Track (NeurIPS-2021), Virtual.
40. Loshchilov, I., and Hutter, F. (2019, January 6–9). Decoupled weight decay regularization. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA.
41. Madry, A., Makelov, A., Schmidt, L., Tsipras, D., and Vladu, A. (May, January 30). Towards deep learning models resistant to adversarial examples. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada.