Deep Neural Network and Pseudo Relevance Feedback Based Query Expansion
Source abstract
Abstract
The neural network has attracted researchers immensely in the last couple of years due to its wide applications in various areas such as Data mining, Natural language processing, Image processing, and Information retrieval etc. Word embedding has been applied by many researchers for Information retrieval tasks. In this paper word embedding-based skip-gram model has been developed for the query expansion task. Vocabulary terms are obtained from the top “k” initially retrieved documents using the Pseudo relevance feedback model and then they are trained using the skip-gram model to find the expansion terms for the user query. The performance of the model based on mean average precision is 0.3176. The proposed model compares with other existing models. An improvement of 6.61%, 6.93%, and 9.07% on MAP value is observed compare to the Original query, BM25 model, and query expansion with the Chi-Square model respectively. The proposed model also retrieves 84, 25, and 81 additional relevant documents compare to the original query, query expansion with Chi-Square model, and BM25 model respectively and thus improves the recall value also. The per query analysis reveals that the proposed model performs well in 30, 36, and 30 queries compare to the original query, query expansion with Chi-square model, and BM25 model respectively.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Information Retrieval and Search Behavior · Data Quality and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (31)
Show source-provided references
1. A taxonomy of web search10.1145/792550.792552 ↗
2. A review of ontology based query expansion10.1016/j.ipm.2006.09.003 ↗
3. T. Mikolov, K. Chen, G. Corrado and J. Dean, “Efficient estimation of word representations in vector space,” ArXiv Preprint ArXiv: 1301.3781, 2013.
4. Glove: Global vectors for word representation
5. A knowledge-based search engine powered by Wikipedia
6. Concept based query expansion
7. ,”
8. Query reformulation using anchor text
9. Mining anchor text for query refinement
10. Query expansion by mining user logs10.1109/TKDE.2003.1209002 ↗
11. Query clustering using user logs10.1145/503104.503108 ↗
12. Query expansion using external evidence
13. Query suggestions in the absence of query logs
14. Aggregating continuous word embeddings for information retrieval
15. Learning to reweight terms with distributed representations
16. Word embedding based generalized language model for information retrieval
17. Distributed representations of words and phrases and their compositionality
18. D. Roy, D. Paul, M. Mitra and U. Garain, “Using word embeddings for automatic query expansion,” ArXiv Preprint ArXiv: 1606.07608, 2016.
19. F. Diaz, B. Mitra and N. Craswell, “Query expansion with locally-trained word embeddings,” ArXiv Preprint ArXiv: 1605.07891, 2016.10.18653/v1/P16-1035 ↗
20. A novel fuzzy logic model for pseudo-relevance feedback-based query expansion10.1007/s40815-016-0254-1 ↗
21. Query expansion using random walk models
22. Combining fields for query expansion and adaptive query expansion10.1016/j.ipm.2006.11.002 ↗
23. Improving search relevance for short queries in community question answering
24. Entity query feature expansion using knowledge base links
25. An approach using fuzzy sets and boosting techniques to predict liver disease10.32604/cmc.2021.016957 ↗
26. Evaluation of breast computationally intelligent techniques for cancer diagnosis10.1007/s00521-020-05204-y ↗
27. T. Mikolov, K. Chen, G. Corrado and J. Dean, “Efficient estimation of word representations in vector space,” ArXiv Preprint ArXiv: 1301.3781, 2013.
28. Query expansion based on NLP and word embeddings
29. Deep neural networks for query expansion using word embeddings
30. Overview of FIRE 2011
31. From puppy to maturity: Experiences in developing terrier