Second-Order Text Matching Algorithm for Agricultural Text
Source abstract
Abstract
Text matching promotes the research and application of deep understanding of text information, and it provides the basis for information retrieval, recommendation systems and natural language processing by exploring the similar structures in text data. Owning to the outstanding performance and automatically extract text features for the target, the methods based-pre-training models gradually become the mainstream. However, such models usually suffer from the disadvantages of slow retrieval speed and low running efficiency. On the other hand, previous text matching algorithms have mainly focused on horizontal domain research, and there are relatively few vertical domain algorithms for agricultural text, which need to be further investigated. To address this issue, a second-order text matching algorithm has been developed. This paper first obtains a large amount of text about typical agricultural crops and constructs a database by using web crawlers and querying relevant textbooks, etc. Then BM25 algorithm is used to generate a candidate set and BERT model is used to filter the optimal match based on the candidate set. Experiments have shown that the Precision@1 of this second-order algorithm can reach 88.34% on the dataset constructed in this paper, and the average time to match a piece of text is only 2.02 s. Compared with BERT model and BM25 algorithm, there is an increase of 8.81% and 13.73% in Precision@1 respectively. In terms of the average time required for matching a text, it is 55.2 s faster than BERT model and only 2 s slower than BM25 algorithm. It can improve the efficiency and accuracy of agricultural information retrieval, agricultural decision support, agricultural market analysis, etc., and promote the sustainable development of agriculture.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Web Data Mining and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Engineering, Shandong Agricultural University, Tai’an 271018, China
Key Laboratory of Huang-Huai-Hai Smart Agricultural Technology of Ministry of Agriculture and Rural Affairs, Tai’an 271018, China
Funding
Shandong Provincial Natural Science Foundation · Open Project Foundation of Intelligent Information Processing Key Laboratory of Shanxi Province
References (42)
Show source-provided references
1. How important is agriculture in China’s economic growth?10.1080/713688306 ↗
2. Lin, C.X., Ding, B., Han, J., Zhu, F., and Zhao, B. (2008, January 15–19). Text cube: Computing ir measures for multidimensional text database analysis. Proceedings of the 2008 8th IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.135 ↗
3. Press “a” for artificial intelligence in agriculture: A review
4. An owl-based specification of database management systems
5. Wang, S., and Jiang, J. (2015). Learning natural language inference with LSTM. arXiv.10.18653/v1/N16-1170 ↗
6. An information-theoretic perspective of tf–idf measures10.1016/S0306-4573(02)00021-3 ↗
7. Tutorial on support vector machine (svm)
8. A sequential feature extraction approach for naïve bayes classification of microarray data10.1016/j.eswa.2009.01.075 ↗
9. Identification of metabolic syndrome using decision tree analysis10.1016/j.diabres.2010.06.009 ↗
10. SIFT matching with CNN evidences for particular object retrieval10.1016/j.neucom.2017.01.081 ↗
11. Selection of orthogonal investment portfolio using Evolino RNN trading model10.1016/j.sbspro.2013.12.962 ↗
12. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
13. Use of GPT for stabilization and acceleration of search mechanisms in industrial core computations10.1016/j.anucene.2019.107013 ↗
14. Cross-language text alignment: A proposed two-level matching scheme for plagiarism detection10.1016/j.eswa.2020.113718 ↗
15. An improved energy efficient duty cycling algorithm for IoT based precision agriculture10.1016/j.procs.2018.10.159 ↗
16. Zhang, J., Liu, J., Chen, Y., Feng, X., and Sun, Z. (2021). Knowledge mapping of machine learning approaches applied in agricultural management—A scientometric review with citespace. Sustainability, 13.10.3390/su13147662 ↗
17. Big data and ai revolution in precision agriculture: Survey and challenges10.1109/ACCESS.2021.3102227 ↗
18. A survey on deep text matching
19. Unlabeled short text similarity with LSTM encoder10.1109/ACCESS.2018.2885698 ↗
20. Lai, Y., Feng, Y., Yu, X., Wang, Z., Xu, K., and Zhao, D. (February, January 27). Lattice cnns for matching based chinese question answering. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
21. Chen, L., Zhao, Y., Lyu, B., Jin, L., Chen, Z., Zhu, S., and Yu, K. (2020, January 5–10). Neural graph matching networks for Chinese short text matching. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online.10.18653/v1/2020.acl-main.547 ↗
22. Xia, T., Wang, Y., Tian, Y., and Chang, Y. (2021, January 19–23). Using prior knowledge to guide bert’s attention in semantic textual matching tasks. Proceedings of the Web Conference 2021, Virtual.10.1145/3442381.3449988 ↗
23. Zhang, K., Wu, L., Lv, G., Wang, M., Chen, E., and Ruan, S. (2021, January 2–9). Making the relation matters: Relation of relation learning network for sentence semantic matching. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i16.17694 ↗
24. Lyu, B., Chen, L., Zhu, S., and Yu, K. (2021, January 2–9). Let: Linguistic knowledge enhanced graph transformer for chinese short text matching. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i15.17592 ↗
25. Short text matching model with multiway semantic interaction based on multi-granularity semantic embedding10.1007/s10489-022-03410-w ↗
26. Severyn, A., and Moschitti, A. (2015, January 9–13). Learning to rank short text pairs with convolutional deep neural networks. Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile.10.1145/2766462.2767738 ↗
27. Pang, L., Lan, Y., Guo, J., Xu, J., Wan, S., and Cheng, X. (2016, January 12–17). Text matching as image recognition. Proceedings of the AAAI Conference on Artificial Intelligence, Phoenix, AZ, USA.10.1609/aaai.v30i1.10341 ↗
28. Abcnn: Attention-based convolutional neural network for modeling sentence pairs10.1162/tacl_a_00097 ↗
29. Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., and Inkpen, D. (2016). Enhanced LSTM for natural language inference. arXiv.10.18653/v1/P17-1152 ↗
30. Wang, Z., Hamza, W., and Florian, R. (2017). Bilateral multi-perspective matching for natural language sentences. arXiv.10.24963/ijcai.2017/579 ↗
31. Wang, H., Zhu, H., Wu, H., Wang, X., Han, X., and Xu, T. (2021). A Densely Connected GRU Neural Network Based on Coattention Mechanism for Chinese Rice-Related Question Similarity Matching. Agronomy, 11.10.3390/agronomy11071307 ↗
32. Question Similarity Measurement of Chinese Crop Diseases and Insect Pests Based on Mixed Information Extraction
33. Research on rice question-and-sentence similarity matching method based on BiLSTM-CNN10.1186/s10033-022-00797-y ↗
34. Agricultural Short Text Matching Technology Based on Multi-semantic Features
35. Densely connected BiGRU neural network based on BERT and attention mechanism for Chinese agriculture-related question similarity matching
36. Pan, Y., Sun, J., Yu, H., Bai, G., Ge, Y., Luck, J., and Awada, T. (2023, January 15–18). Transforming Agriculture with Intelligent Data Management and Insights. Proceedings of the 2023 IEEE International Conference on Big Data, Sorrento, Italy.10.1109/BigData59044.2023.10386589 ↗
37. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv.
38. Yang, H. (2019). Bert meets chinese word segmentation. arXiv.
39. Improved Word Segmentation System for Chinese Criminal Judgment Documents10.1080/08839514.2023.2297524 ↗
40. Yang, C., Wang, S., Li, Y., Yang, C., Yan, M., Zhang, J., and Lin, F. (2020). CoRe: An Efficient Coarse-refined Training Framework for BERT. arXiv.
41. Liu, X., Chen, Q., Deng, C., Zeng, H., Chen, J., Li, D., and Tang, B. (2018, January 20–26). Lcqmc: A large-scale chinese question matching corpus. Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, NM, USA.
42. Rau, D., and Kamps, J. (2022, January 10–14). How different are pre-trained transformers for text ranking?. Proceedings of the European Conference on Information Retrieval, Stavanger, Norway.10.1007/978-3-030-99739-7_24 ↗