journal article·2019-09-05Open access

Neural Machine Reading Comprehension: Methods and Trends

Shanshan Liu, Xin Zhang, Sheng Zhang, Hui Wang, Weiming Zhang

Applied Sciences· Volume 9· Issue 18

Abstract

Machine reading comprehension (MRC), which requires a machine to answer questions based on a given context, has attracted increasing attention with the incorporation of various deep-learning techniques over the past few years. Although research on MRC based on deep learning is flourishing, there remains a lack of a comprehensive survey summarizing existing approaches and recent trends, which motivated the work presented in this article. Specifically, we give a thorough review of this research field, covering different aspects including (1) typical MRC tasks: their definitions, differences, and representative datasets; (2) the general architecture of neural MRC: the main modules and prevalent approaches to each; and (3) new trends: some emerging areas in neural MRC as well as the corresponding challenges. Finally, considering what has been achieved so far, the survey also envisages what the future may hold by discussing the open issues left to be addressed.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Natural Language Processing Techniques · Text Readability and Simplification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Science and Technology on Information Systems Engineering Laboratory, College of Systems Engineering, National University of Defense Technology, Changsha 410073, China

References (100+)

Show source-provided references
1. Lehnert, W.G. (1977). The Process of Question Answering. [Ph.D. Thesis, Yale University].
2. Hirschman, L., Light, M., Breck, E., and Burger, J.D. (1999, January 20–26). Deep Read: A Reading Comprehension System. Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics on Computational Linguistics, College Park, MD, USA.10.3115/1034678.1034731 ↗
3. Riloff, E., and Thelen, M. (2000, January 4). A Rule-Based Question Answering System for Reading Comprehension Tests. Proceedings of the 2000 ANLP/NAACL Workshop on Reading Comprehension Tests as Evaluation for Computer-based Language Understanding Sytems—Volume 6, Seattle, WA, USA.10.3115/1117595.1117598 ↗
4. Poon, H., Christensen, J., Domingos, P., Etzioni, O., Hoffmann, R., Kiddon, C., Lin, T., Ling, X., Ritter, A., and Schoenmackers, S. (2010, January 6). Machine Reading at the University of Washington. Proceedings of the NAACL HLT 2010 First International Workshop on Formalisms and Methodology for Learning by Reading, Los Angeles, CA, USA.
5. Hermann, K.M., Kočiskỳ, T., Grefenstette, E., Espeholt, L., Kay, W., Suleyman, M., and Blunsom, P. (2015, January 7–12). Teaching Machines to Read and Comprehend. Proceedings of the 28th International Conference on Neural Information Processing Systems—Volume 1, Montreal, QC, Canada.
6. Rajpurkar, P., Zhang, J., Lopyrev, K., and Liang, P. (2016, January 1–5). SQuAD: 100,000+ Questions for Machine Comprehension of Text. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1264 ↗
7. Nguyen, T., Rosenberg, M., Song, X., Gao, J., Tiwary, S., Majumder, R., and Deng, L. (2016). MS MARCO: A Human Generated Machine Reading Comprehension Dataset. arXiv.
8. Qiu, B., Chen, X., Xu, J., and Sun, Y. (2019). A Survey on Neural Machine Reading Comprehension. arXiv.
9. Chen, D. (2018). Neural Reading Comprehension and Beyond. [Ph.D. Thesis, Stanford University].
10. Lai, G., Xie, Q., Liu, H., Yang, Y., and Hovy, E. (2017, January 7–11). RACE: Large-Scale ReAding Comprehension Dataset from Examinations. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.10.18653/v1/D17-1082 ↗
11. Sukhbaatar, S., Weston, J., Fergus, R., and Szlam, A. (2015). End-to-End Memory Networks. Advances in Neural Information Processing Systems, Neural Information Processing Systems Foundation, Inc.
12. Chen, D., Bolton, J., and Manning, C.D. (2016, January 7–12). A Thorough Examination of the CNN/Daily Mail Reading Comprehension Task. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany.10.18653/v1/P16-1223 ↗
13. Kadlec, R., Schmid, M., Bajgar, O., and Kleindienst, J. (2016, January 7–12). Text Understanding with the Attention Sum Reader Network. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany.10.18653/v1/P16-1086 ↗
14. Sordoni, A., Bachman, P., Trischler, A., and Bengio, Y. (2016). Iterative Alternating Neural Attention for Machine Reading. arXiv.
15. Wang, S., and Jiang, J. (2016). Machine Comprehension Using Match-LSTM and Answer Pointer. arXiv.
16. Seo, M., Kembhavi, A., Farhadi, A., and Hajishirzi, H. (2016). Bidirectional Attention Flow for Machine Comprehension. arXiv.
17. Xiong, C., Zhong, V., and Socher, R. (2016). Dynamic Coattention Networks for Question Answering. arXiv.
18. Cui, Y., Chen, Z., Wei, S., Wang, S., Liu, T., and Hu, G. (August, January 30). Attention-over-Attention Neural Networks for Reading Comprehension. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
19. Dhingra, B., Liu, H., Yang, Z., Cohen, W., and Salakhutdinov, R. (August, January 30). Gated-Attention Readers for Text Comprehension. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
20. Pan, B., Li, H., Zhao, Z., Cao, B., Cai, D., and He, X. (2017). MEMEN: Multi-Layer Embedding with Memory Networks for Machine Comprehension. arXiv.
21. Wang, W., Yang, N., Wei, F., Chang, B., and Zhou, M. (August, January 30). Gated Self-Matching Networks for Reading Comprehension and Question Answering. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
22. Xiong, C., Zhong, V., and Socher, R. (2017). DCN+: Mixed Objective and Deep Residual Coattention for Question Answering. arXiv.
23. Tan, C., Wei, F., Yang, N., Du, B., Lv, W., and Zhou, M. (2018, January 2–7). S-Net: From Answer Extraction to Answer Synthesis for Machine Reading Comprehension. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.12035 ↗
24. McCann, B., Bradbury, J., Xiong, C., and Socher, R. (2017, January 4–9). Learned in Translation: Contextualized Word Vectors. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
25. Yu, A.W., Dohan, D., Luong, M.T., Zhao, R., Chen, K., Norouzi, M., and Le, Q.V. (2018). QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehension. arXiv.
26. Hu, M., Peng, Y., Huang, Z., Qiu, X., Wei, F., and Zhou, M. (2018, January 13–19). Reinforced Mnemonic Reader for Machine Reading Comprehension. Proceedings of the 27th International Joint Conference on Artificial Intelligence, Stockholm, Sweden, CA, USA.10.24963/ijcai.2018/570 ↗
27. Chen, Z., Cui, Y., Ma, W., Wang, S., and Hu, G. (2018). Convolutional Spatial Attention Model for Reading Comprehension with Multiple-Choice Questions. arXiv.10.1609/aaai.v33i01.33016276 ↗
28. Chaturvedi, A., Pandit, O., and Garain, U. (2018, January 15–20). CNN for Text-Based Multiple Choice Question Answering. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Melbourne, Australia.10.18653/v1/P18-2044 ↗
29. Zhu, H., Wei, F., Qin, B., and Liu, T. (2018, January 2–7). Hierarchical Attention Flow for Multiple-Choice Reading Comprehension. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.12040 ↗
30. Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018). Deep Contextualized Word Representations. arXiv.10.18653/v1/N18-1202 ↗
31. Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2018). Improving Language Understanding by Generative Pre-Training, OpenAI. Technical Report.
32. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 3–5). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
33. Dhingra, B., Liu, H., Salakhutdinov, R., and Cohen, W.W. (2017). A Comparative Study of Word Embeddings for Reading Comprehension. arXiv.
34. Baeza-Yates, R., and Ribeiro-Neto, B. (2011). Modern Information Retrieval, Addison-Wesley.10.1145/2009916.2010172 ↗
35. Learning Representations by Back-Propagating Errors10.1038/323533a0 ↗
36. Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., and Dean, J. (2013, January 5–10). Distributed Representations of Words and Phrases and Their Compositionality. Proceedings of the 26th International Conference on Neural Information Processing Systems, Lake Tahoe, NV, USA.
37. Pennington, J., Socher, R., and Manning, C. (2014, January 25–29). Glove: Global Vectors for Word Representation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1162 ↗
38. Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014). Learning Phrase Representations Using RNN Encoder-Decoder for Statistical Machine Translation. arXiv.10.3115/v1/D14-1179 ↗
39. Nakov, P., Ritter, A., Rosenthal, S., Sebastiani, F., and Stoyanov, V. (2016, January 16–17). SemEval-2016 Task 4: Sentiment Analysis in Twitter. Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016), San Diego, CA, USA.10.18653/v1/S16-1001 ↗
40. Clark, C., and Gardner, M. (2018, January 15–20). Simple and Effective Multi-Paragraph Reading Comprehension. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1078 ↗
41. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is All You Need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
42. Language Models are Unsupervised Multi-Task Learners
43. Wang, Z., Mi, H., Hamza, W., and Florian, R. (2016). Multi-Perspective Context Matching for Machine Comprehension. arXiv.
44. Yang, Z., Dhingra, B., Yuan, Y., Hu, J., Cohen, W.W., and Salakhutdinov, R. (2016). Words or Characters? Fine-Grained Gating for Reading Comprehension. arXiv.
45. Chen, D., Fisch, A., Weston, J., and Bordes, A. (August, January 30). Reading Wikipedia to Answer Open-Domain Questions. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
46. Zhang, J., Zhu, X., Chen, Q., Dai, L., Wei, S., and Jiang, H. (2017). Exploring Question Understanding and Adaptation in Neural-Network-Based Question Answering. arXiv.10.1109/CompComm.2017.8322883 ↗
47. Long Sort-Term Memory10.1162/neco.1997.9.8.1735 ↗
48. Bahdanau, D., Cho, K., and Bengio, Y. (2014). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.
49. Luong, M.T., Pham, H., and Manning, C.D. (2015). Effective Approaches to Attention-Based Neural Machine Translation. arXiv.10.18653/v1/D15-1166 ↗
50. Rush, A.M., Chopra, S., and Weston, J. (2015). A Neural Attention Model for Abstractive Sentence Summarization. arXiv.10.18653/v1/D15-1044 ↗
51. Wang, Y., Huang, M., and Zhao, L. (2016, January 1–5). Attention-Based LSTM for Aspect-Level Sentiment Classification. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1058 ↗
52. Cheng, H., Fang, H., He, X., Gao, J., and Deng, L. (2016). Bi-Directional Attention with Agreement for Dependency Parsing. arXiv.10.18653/v1/D16-1238 ↗
53. Cui, Y., Liu, T., Chen, Z., Wang, S., and Hu, G. (2016, January 11–16). Consensus Attention-Based Neural Networks for Chinese Reading Comprehension. Proceedings of the COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, Osaka, Japan.
54. Weston, J., Chopra, S., and Bordes, A. (2014). Memory Networks. arXiv.
55. Yu, S., Indurthi, S.R., Back, S., and Lee, H. (2018, January 19). A Multi-Stage Memory Augmented Neural Network for Machine Reading Comprehension. Proceedings of the Workshop on Machine Reading for Question Answering, Melbourne, Australia.10.18653/v1/W18-2603 ↗
56. Vinyals, O., Fortunato, M., and Jaitly, N. (2015, January 7–12). Pointer Networks. Proceedings of the 28th International Conference on Neural Information Processing Systems, Montreal, QC, Canada.
57. Goodfellow, I.J., Warde-Farley, D., Mirza, M., Courville, A., and Bengio, Y. (2013). Maxout Networks. arXiv.
58. Srivastava, R.K., Greff, K., and Schmidhuber, J. (2015). Highway Networks. arXiv.
59. Shen, Y., Huang, P.S., Gao, J., and Chen, W. (2017, January 13–17). Reasonet: Learning to Stop Reading in Machine Comprehension. Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Halifax, NS, Canada.10.1145/3097983.3098177 ↗
60. Trischler, A., Ye, Z., Yuan, X., Bachman, P., Sordoni, A., and Suleman, K. (2016, January 1–5). Natural Language Comprehension with the EpiReader. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1013 ↗
61. Yu, Y., Zhang, W., Hasan, K., Yu, M., Xiang, B., and Zhou, B. (2016). End-to-End Answer Chunk Extraction and Ranking for Reading Comprehension. arXiv.
62. Min, S., Zhong, V., Socher, R., and Xiong, C. (2018, January 15–20). Efficient and Robust Question Answering from Minimal Context over Documents. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1160 ↗
63. Suster, S., and Daelemans, W. (2018, January 1–6). CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehension. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, LA, USA.10.18653/v1/N18-1140 ↗
64. Onishi, T., Wang, H., Bansal, M., Gimpel, K., and McAllester, D. (2016, January 1–5). Who did What: A Large-Scale Person-Centered Cloze Dataset. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1241 ↗
65. Saha, A., Aralikatte, R., Khapra, M.M., and Sankaranarayanan, K. (2018, January 15–20). DuoRC: Towards Complex Language Understanding with Paraphrased Reading Comprehension. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1156 ↗
66. Hill, F., Bordes, A., Chopra, S., and Weston, J. (2015). The Goldilocks Principle: Reading Children’s Books with Explicit Memory Representations. arXiv.
67. Bajgar, O., Kadlec, R., and Kleindienst, J. (2016). Embracing Data Abundance: Booktest Dataset for Reading Comprehension. arXiv.
68. Paperno, D., Kruszewski, G., Lazaridou, A., Pham, N.Q., Bernardi, R., Pezzelle, S., Baroni, M., Boleda, G., and Fernandez, R. (2016, January 7–12). The LAMBADA Dataset: Word Prediction Requiring a Broad Discourse Context. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Berlin, Germany.10.18653/v1/P16-1144 ↗
69. Xie, Q., Lai, G., Dai, Z., and Hovy, E. (November, January 31). Large-Scale Cloze Test Dataset Created by Teachers. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.10.18653/v1/D18-1257 ↗
70. Richardson, M., Burges, C.J., and Renshaw, E. (2013, January 18–21). MCTest: A Challenge Dataset for the Open-Domain Machine Comprehension of Text. Proceedings of the 2013 Conference on Empirical Methods in Natural Language Processing, Seattle, WA, USA.
71. Trischler, A., Wang, T., Yuan, X., Harris, J., Sordoni, A., Bachman, P., and Suleman, K. (2017, January 3). NewsQA: A Machine Comprehension Dataset. Proceedings of the 2nd Workshop on Representation Learning for NLP, Vancouver, BC, Canada.10.18653/v1/W17-2623 ↗
72. Rajpurkar, P., Jia, R., and Liang, P. (2018, January 15–20). Know What You Don’t Know: Unanswerable Questions for SQuAD. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Melbourne, Australia.10.18653/v1/P18-2124 ↗
73. Joshi, M., Choi, E., Weld, D., and Zettlemoyer, L. (August, January 30). TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehension. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
74. Weston, J., Bordes, A., Chopra, S., Rush, A.M., van Merriënboer, B., Joulin, A., and Mikolov, T. (2015). Towards AI-Complete Question Answering: A Set of Prerequisite Toy Tasks. arXiv.
75. Dunn, M., Sagun, L., Higgins, M., Guney, V.U., Cirik, V., and Cho, K. (2017). SearchQA: A New Q&A Dataset Augmented with Context from a Search Engine. arXiv.
76. The NarrativeQA Reading Comprehension Challenge10.1162/tacl_a_00023 ↗
77. He, W., Liu, K., Liu, J., Lyu, Y., Zhao, S., Xiao, X., Liu, Y., Wang, Y., Wu, H., and She, Q. (2018, January 19). DuReader: A Chinese Machine Reading Comprehension Dataset from Real-world Applications. Proceedings of the Workshop on Machine Reading for Question Answering, Melbourne, Australia.10.18653/v1/W18-2605 ↗
78. Lin, C.Y. (2004, January 25–26). Rouge: A Package for Automatic Evaluation of Summaries. Proceedings of the Workshop on Text Summarization Branches Out, Barcelona, Spain.
79. Papineni, K., Roukos, S., Ward, T., and Zhu, W.J. (2002, January 7–12). BLEU: A Method for Automatic Evaluation of Machine Translation. Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Philadelphia, PA, USA.10.3115/1073083.1073135 ↗
80. Ostermann, S., Modi, A., Roth, M., Thater, S., and Pinkal, M. (2018, January 7–12). MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledge. Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC-2018), Miyazaki, Japan.
81. Long, T., Bengio, E., Lowe, R., Cheung, J.C.K., and Precup, D. (2017, January 7–11). World Knowledge for Reading Comprehension: Rare Entity Prediction with Hierarchical LSTMs Using External Descriptions. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.10.18653/v1/D17-1086 ↗
82. Yang, B., and Mitchell, T. (August, January 30). Leveraging Knowledge Bases in LSTMs for Improving Machine Reading. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Vancouver, BC, Canada.
83. Mihaylov, T., and Frank, A. (2018, January 15–20). Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1076 ↗
84. Sun, Y., Guo, D., Tang, D., Duan, N., Yan, Z., Feng, X., and Qin, B. (2018). Knowledge Based Machine Reading Comprehension. arXiv.
85. Miller, A., Fisch, A., Dodge, J., Karimi, A.H., Bordes, A., and Weston, J. (2016, January 1–5). Key-Value Memory Networks for Directly Reading Documents. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, TX, USA.10.18653/v1/D16-1147 ↗
86. Wang, C., and Jiang, H. (August, January 28). Explicit Utilization of General Knowledge in Machine Reading Comprehension. Proceedings of the 57th Conference of the Association for Computational Linguistics, Florence, Italy.
87. Levy, O., Seo, M., Choi, E., and Zettlemoyer, L. (2017, January 3–4). Zero-Shot Relation Extraction via Reading Comprehension. Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), Vancouver, BC, Canada.10.18653/v1/K17-1034 ↗
88. Tan, C., Wei, F., Zhou, Q., Yang, N., Lv, W., and Zhou, M. (2018, January 26–30). I Know There Is No Answer: Modeling Answer Validation for Machine Reading Comprehension. Proceedings of the CCF International Conference on Natural Language Processing and Chinese Computing, Hohhot, China.10.1007/978-3-319-99495-6_8 ↗
89. Hu, M., Wei, F., Peng, Y., Huang, Z., Yang, N., and Li, D. (February, January 27). Read+ Verify: Machine Reading Comprehension with Unanswerable Questions. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA.
90. Sun, F., Li, L., Qiu, X., and Liu, Y. (2018). U-Net: Machine Reading Comprehension with Unanswerable Questions. arXiv.
91. Dhingra, B., Mazaitis, K., and Cohen, W.W. (2017). Quasar: Datasets for Question Answering by Search and Reading. arXiv.
92. Htut, P.M., Bowman, S.R., and Cho, K. (2018, January 2–4). Training a Ranking Function for Open-Domain Question Answering. Proceedings of the NAACL HLT 2018, New Orleans, LA, USA.10.18653/v1/N18-4017 ↗
93. Lee, J., Yun, S., Kim, H., Ko, M., and Kang, J. (November, January 31). Ranking Paragraphs for Improving Answer Recall in Open-Domain Question Answering. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.10.18653/v1/D18-1053 ↗
94. Wang, S., Yu, M., Guo, X., Wang, Z., Klinger, T., Zhang, W., Chang, S., Tesauro, G., Zhou, B., and Jiang, J. (2018, January 2–7). R 3: Reinforced Ranker-Reader for Open-Domain Question Answering. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.10.1609/aaai.v32i1.12053 ↗
95. Das, R., Dhuliawala, S., Zaheer, M., and McCallum, A. (2019). Multi-Step Retriever-Reader Interaction for Scalable Open-domain Question Answering. arXiv.
96. Pang, L., Lan, Y., Guo, J., Xu, J., Su, L., and Cheng, X. (2019). HAS-QA: Hierarchical Answer Spans Model for Open-domain Question Answering. arXiv.10.1609/aaai.v33i01.33016875 ↗
97. Lin, Y., Ji, H., Liu, Z., and Sun, M. (2018, January 15–20). Denoising Distantly Supervised Open-Domain Question Answering. Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Melbourne, Australia.10.18653/v1/P18-1161 ↗
98. Wang, S., Yu, M., Jiang, J., Zhang, W., Guo, X., Chang, S., Wang, Z., Klinger, T., Tesauro, G., and Cambell, M. (2017). Evidence Aggregation for Answer Re-Ranking in Open-Domain Question Answering. arXiv.
99. CoQA: A Conversational Question Answering Challenge10.1162/tacl_a_00266 ↗
100. Choi, E., He, H., Iyyer, M., Yatskar, M., Yih, W.t., Choi, Y., Liang, P., and Zettlemoyer, L. (November, January 31). QuAC: Question Answering in Context. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium.10.18653/v1/D18-1241 ↗