Conversational AI over Military Scenarios Using Intent Detection and Response Generation
Source abstract
Abstract
With the rise of artificial intelligence, conversational agents (CA) have found use in various applications in the commerce and service industries. In recent years, many conversational datasets have becomes publicly available, most relating to open-domain social conversations. However, it is difficult to obtain domain-specific or language-specific conversational datasets. This work focused on developing conversational systems based on the Chinese corpus over military scenarios. The soldier will need information regarding their surroundings and orders to carry out their mission in an unfamiliar environment. Additionally, using a conversational military agent will help soldiers obtain immediate and relevant responses while reducing labor and cost requirements when performing repetitive tasks. This paper proposes a system architecture for conversational military agents based on natural language understanding (NLU) and natural language generation (NLG). The NLU phase comprises two tasks: intent detection and slot filling. Detecting intent and filling slots involves predicting the user’s intent and extracting related entities. The goal of the NLG phase, in contrast, is to provide answers or ask questions to clarify the user’s needs. In this study, the military training task was when soldiers sought information via a conversational agent during the mission. In summary, we provide a practical approach to enabling conversational agents over military scenarios. Additionally, the proposed conversational system can be trained by other datasets for future application domains.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Topic Modeling · Sentiment Analysis and Opinion Mining · AI in Service Interactions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science and Information Engineering, Chung Cheng Institute of Technology, National Defense University, Taoyuan City 335, Taiwan
Funding
Ministry of Science and Technology
References (70)
Show source-provided references
1. Khari, J. (2021, October 04). Facebook Messenger Passes 300,000 bots. VentureBeat, 1 May 2018. Available online: https://venturebeat.com/2018/05/01/facebook-messenger-passes-300000-bots/.
2. (2021, October 04). What Do Your Customers Actually Think About Chatbots? Userlike, 12 July 2021. Available online: https://userlike.com/en/blog/consumer-chatbot-perceptions.
3. Helena, P. (2021, October 04). What Does the Future of Military Comms Look Like? STEM Awards 2020. Available online: https://www.telegraph.co.uk/education/stem-awards/defence-technology/military-communication-on-the-battlefield/.
4. Shafquat, H., Sianaki, O.A., and Ababneh, N. (2019, January 27–29). A Survey on Conversational Agents/Chatbots Classification and Design Techniques. Proceedings of the Workshops of the 33rd International Conference on Advanced Information Networking and Applications (WAINA-2019), AINA Workshops, Matsue, Japan.
5. Singh, S., and Beniwal, H. (J. King Saud Univ.-Comput. Inf. Sci., 2021). A survey on near-human conversational agents, J. King Saud Univ.-Comput. Inf. Sci., in press.10.1016/j.jksuci.2021.10.013 ↗
6. Goel, P., and Ganatra, A. (2021, January 13–14). A Survey on Chatbot: Futuristic Conversational Agent for User Interaction. Proceedings of the 2021 3rd International Conference on Signal Processing and Communication (ICPSC), Coimbatore, India.10.1109/ICSPC51351.2021.9451763 ↗
7. Ramesh, K., Ravishankaran, S., Joshi, A., and Chandrasekaran, K. (2017, January 13). A Survey of Design Techniques for Conversational Agents. Proceedings of the Second International Conference, ICICCT 2017, New Delhi, India.10.1007/978-981-10-6544-6_31 ↗
8. Trieu, H., Iida, H., Bao, N.P.H., and Nguyen, L.M. (2017, January 24–26). Towards Developing Dialogue Systems with Entertaining Conversations. Proceedings of the 9th International Conference on Agents and Artificial Intelligence (ICAART 2017), Porto, Portugal.10.5220/0006192105110518 ↗
9. Altinok, D. (2018). An Ontology-Based Dialogue Management System for Banking and Finance Dialogue Systems. arXiv.
10. Zeng, G., Yang, W., Ju, Z., Yang, Y., Wang, S., Zhang, R., Zhou, M., Zeng, J., Dong, X., and Zhang, R. (2020, January 16–20). MedDialog: Large-scale Medical Dialogue Datasets. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Online.10.18653/v1/2020.emnlp-main.743 ↗
11. Liu, W., Tang, J., Qin, J., Xu, L., Li, Z., and Liang, X. (2020). MedDG: A Large-scale Medical Consultation Dataset for Building Medical Dialogue System. arXiv.
12. Sharma, M., Russell-Rose, T., Barakat, L., and Matsuo, A. (2021). Building a Legal Dialogue System: Development Process, Challenges and Opportunities. arXiv.
13. Automatic Dialogue System of Marriage Law Based on the Parallel C4.5 Decision Tree10.1109/ACCESS.2020.2972586 ↗
14. Huang, C. (2021, January 15–17). The Intelligent Agent NLP-Based Customer Service System. Proceedings of the 2021 2nd International Conference on Artificial Intelligence in Electronics Engineering, Phuket, Thailand.10.1145/3460268.3460275 ↗
15. The Future Navy—Near-Term Applications of Artificial Intelligence
16. Chui, M., Manyika, J., and Miremadi, M. (2016). Where Machines Could Replace Humans—And Where They Can’t (Yet), McKinsey & Company.
17. Kim, S., Salter, D., DeLuccia, L., and Tamrakar, A. (2020, January 10–13). Study on Text-Based and Voice-Based Dialogue Interfaces for Human-Computer Interactions in a Blocks World. Proceedings of the 8th International Conference on Human-Agent Interaction, HAI’20, Virtual Event, Australia.10.1145/3406499.3418754 ↗
18. Anwer, S., Waris, A., Sultan, H., Butt, S.I., Zafar, M.H., Sarwar, M., Niazi, I.K., Shafique, M., and Pujari, A.N. (2020). Eye and Voice-Controlled Human Machine Interface System for Wheelchairs Using Image Gradient Approach. Sensors, 20.10.3390/s20195510 ↗
19. Dialogue Systems for Intelligent Human Computer Interactions10.1016/j.entcs.2019.04.010 ↗
20. Marchi, E., Siniscalchi, S.M., Cumani, S., Salerno, V.M., and Li, H. (2021). A Classification-Based Approach to Automating Human-Robot Dialogue. Increasing Naturalness and Flexibility in Spoken Dialogue Interaction, Proceedings of the 10th International Workshop on Spoken Dialogue Systems, Siracusa, Italy, 24–26 April 2019, Springer.10.1007/978-981-15-9323-9 ↗
21. Robb, D.A., Chiyah Garcia, F.J., Laskov, A., Liu, X., Patron, P., and Hastie, H. (2018). Keep Me in the Loop: Increasing Operator Situation Awareness through a Conversational Multimodal Interface. ICMI ’18, Proceedings of the 20th ACM International Conference on Multimodal Interaction, Boulder, CO, USA, 16–20 October 2018, Association for Computing Machinery.10.1145/3242969.3242974 ↗
22. Allouch, M., Azaria, A., and Azoulay, R. (2021). Conversational Agents: Goals, Technologies, Vision and Challenges. Sensors, 21.10.3390/s21248448 ↗
23. He, T., Xu, X., Wu, Y., Wang, H., and Chen, J. (2021). Multitask Learning with Knowledge Base for Joint Intent Detection and Slot Filling. Appl. Sci., 11.10.3390/app11114887 ↗
24. Support-Vector Networks10.1007/BF00994018 ↗
25. Manning, C.D., Raghavan, P., and Schütze, H. (2008). Introduction to Information Retrieval, Cambridge University Press.10.1017/CBO9780511809071 ↗
26. Learning to Rank for Information Retrieval10.1561/1500000016 ↗
27. Chen, H., Liu, X., Yin, D., and Tang, J. (2017). A Survey on Dialogue Systems: Recent Advances and New Frontiers. arXiv.10.1145/3166054.3166058 ↗
28. Adebayo, K.J., Caro, L.D., Robaldo, L., and Boella, G. (2017, January 21–23). Legalbot: A Deep Learning-Based Conversational Agent in the Legal Domain. Proceedings of the 22nd International Conference on Applications of Natural Language to Information Systems, NLDB 2017, Liège, Belgium.
29. ELIZA—A computer program for the study of natural language communication between man and machine10.1145/365153.365168 ↗
30. Delivering Cognitive Behavior Therapy to Young Adults with Symptoms of Depression and Anxiety Using a Fully Automated Conversational Agent (Woebot): A Randomized Controlled Trial10.2196/mental.7785 ↗
31. Zhang, Y., Chen, X., Ai, Q., Yang, L., and Croft, W.B. (2018, January 22–26). Towards Conversational Search and Recommendation: System Ask, User Respond. Proceedings of the 27th ACM International Conference on Information and Knowledge Management, CIKM’18, Torino, Italy.10.1145/3269206.3271776 ↗
32. Zhao, T., and Eskénazi, M. (2016). Towards End-to-End Learning for Dialog State Tracking and Management using Deep Reinforcement Learning. arXiv.10.18653/v1/W16-3601 ↗
33. The Evaluation of User Experience Testing for Retrieval-based Model and Deep Learning Conversational Agent
34. Zhang, L., Li, W., Bai, Q., and Lai, E. (2021). Graph-Based Self-Adaptive Conversational Agent. AAMAS ’21, Proceedings of the 20th International Conference on Autonomous Agents and MultiAgent Systems, Online, 3–7 May 2021, International Foundation for Autonomous Agents and Multiagent Systems.
35. Roque, A., Leuski, A., Sridhar, V.K.R., Robinson, S., Vaswani, A., Narayanan, S.S., and Traum, D.R. (2006, January 17–21). Radiobot-CFF: A spoken dialogue system for military training. Proceedings of the INTERSPEECH, Pittsburgh, PA, USA.10.21437/Interspeech.2006-151 ↗
36. Gandhe, S., Whitman, N., Traum, D., and Artstein, R. (2009, January 12). An Integrated Authoring Tool for Tactical Questioning Dialogue Systems. Proceedings of the 6th IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems, Pasadena, CA, USA.
37. Malik, N., Sharan, A., and Biswas, P. (2013, January 26–28). Domain knowledge enriched framework for restricted domain question answering system. Proceedings of the 2013 IEEE International Conference on Computational Intelligence and Computing Research, Enathi, India.10.1109/ICCIC.2013.6724163 ↗
38. Moldovan, D., Paşca, M., Harabagiu, S., and Surdeanu, M. (2002). Performance Issues and Error Analysis in an Open-Domain Question Answering System. ACL ’02, Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Philadelphia, PA, USA, 6–12 July 2002, Association for Computational Linguistics.10.3115/1073083.1073091 ↗
39. Setyawan, M.Y.H., Awangga, R.M., and Efendi, S.R. (2018, January 3–4). Comparison Of Multinomial Naive Bayes Algorithm And Logistic Regression For Intent Classification In Chatbot. Proceedings of the 2018 International Conference on Applied Engineering (ICAE), Batam, Indonesia.
40. Wang, S., and Manning, C. (2012, January 8–14). Baselines and Bigrams: Simple, Good Sentiment and Topic Classification. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Jeju Island, Korea.
41. Amber, N., Sahare, P., and Pandya, K. (2018). Intent Detection and Slots Prompt in a Closed-Domain Chatbot. arXiv.
42. Chen, L., Zhang, D., and Mark, L. (2012). Understanding User Intent in Community Question Answering. WWW ’12 Companion, Proceedings of the 21st International Conference on World Wide Web, Lyon, France, 16–20 April 2012, Association for Computing Machinery.10.1145/2187980.2188206 ↗
43. Bhargava, A., Celikyilmaz, A., Hakkani-Tür, D., and Sarikaya, R. (2013, January 26–31). Easy contextual intent prediction and slot detection. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.10.1109/ICASSP.2013.6639291 ↗
44. Draskovic, D., Gencel, V., Zitnik, S., Bajec, M., and Nikolić, B. (2016, January 22–23). A software agent for social networks using natural language processing techniques. Proceedings of the 2016 24th Telecommunications Forum (TELFOR), Belgrade, Serbia.10.1109/TELFOR.2016.7818921 ↗
45. Gaikwad, G., and Joshi, D.J. (2016, January 26–27). Multiclass mood classification on Twitter using lexicon dictionary and machine learning algorithms. Proceedings of the 2016 International Conference on Inventive Computation Technologies (ICICT), Coimbatore, India.10.1109/INVENTIVE.2016.7823247 ↗
46. Sullivan, K.O. (2018). Comparing the Effectiveness of Support Vector Machines and Convolutional Neural Networks for Determining User Intent in Conversational Agents. [Master’s Thesis, Technological University Dublin].
47. Troussas, C., Krouska, A., Sgouropoulou, C., and Voyiatzis, I. (2020). Ensemble Learning Using Fuzzy Weights to Improve Learning Style Identification for Adapted Instructional Routines. Entropy, 22.10.3390/e22070735 ↗
48. Rustamov, S., Bayramova, A., and Alasgarov, E. (2021). Development of Dialogue Management System for Banking Services. Appl. Sci., 11.10.3390/app112210995 ↗
49. Liu, Y., Qiu, M., Qu, C., Chen, C., Guo, J., Zhang, Y., Croft, W.B., and Chen, H. (2020). IART: Intent-aware Response Ranking with Transformers in Information-seeking Conversation Systems. arXiv.
50. Weld, H., Huang, X., Long, S., Poon, J., and Han, S.C. (2021). A survey of joint intent detection and slot-filling models in natural language understanding. arXiv.10.1145/3547138 ↗
51. Hemphill, C.T., Godfrey, J.J., and Doddington, G.R. (1990). The ATIS Spoken Language Systems Pilot Corpus. Speech and Natural Language, Proceedings of the Workshop Held at Hidden Valley, PA, USA, 24–27 June 1990, Texas Instruments Inc.10.3115/116580.116613 ↗
52. Mrksic, N., Séaghdha, D.Ó., Wen, T., Thomson, B., and Young, S.J. (2016). Neural Belief Tracker: Data-Driven Dialogue State Tracking. arXiv.10.18653/v1/P17-1163 ↗
53. Shah, P., Hakkani-Tür, D., Tür, G., Rastogi, A., Bapna, A., Nayak, N., and Heck, L.P. (2018). Building a Conversational Agent Overnight with Dialogue Self-Play. arXiv.
54. Sneiders, E. (2002). Automated Question Answering: Template-Based Approach. [Ph.D. Thesis, Royal Institute of Technology and Stockholm University].
55. Stapley, B., and Benoit, G. (2000, January 5–9). Biobibliometrics: Information retrieval and visualization from co-occurrences of gene names in MEDLINE abstracts. Proceedings of the Pacific Symposium on Biocomputing, Honolulu, HI, USA.
56. Fiszman, M., Rindflesch, T., and Kilicoglu, H. (2003, January 8–12). Integrating a Hypernymic Proposition Interpreter into a Semantic Processor for Biomedical Texts. Proceedings of the AMIA…Annual Symposium Proceedings/AMIA Symposium, Washington, DC, USA.
57. Bhoir, V., and Potey, M.A. (2014, January 17–19). Question answering system: A heuristic approach. Proceedings of the Fifth International Conference on the Applications of Digital Information and Web Technologies (ICADIWT 2014), Bangalore, India.10.1109/ICADIWT.2014.6814704 ↗
58. Chatlog Disentanglement based on Similarity Evaluation Via Reply Message Pairs Prediction Task
59. Bartl, A., and Spanakis, G. (2017). A retrieval-based dialogue system utilizing utterance and context embeddings. arXiv.10.1109/ICMLA.2017.00011 ↗
60. Juraska, J., Karagiannis, P., Bowden, K., and Walker, M. (2018, January 1–6). A Deep Ensemble Model with Slot Alignment for Sequence-to-Sequence Natural Language Generation. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, LA, USA.10.18653/v1/N18-1014 ↗
61. Song, K., Tan, X., Qin, T., Lu, J., and Liu, T. (2019). MASS: Masked Sequence to Sequence Pre-training for Language Generation. arXiv.
62. Wang, J., Liu, J., Bi, W., Liu, X., He, K., Xu, R., and Yang, M. (2019). Improving Knowledge-aware Dialogue Generation via Knowledge Base Question Answering. arXiv.10.1609/aaai.v34i05.6453 ↗
63. Moon, S., Shah, P., Kumar, A., and Subba, R. (August, January 28). OpenDialKG: Explainable Conversational Reasoning with Attention-based Walks over Knowledge Graphs. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.
64. Bockhorst, J., Conathan, D., and Fung, G.M. (2019, January 8–14). Knowledge Graph-Driven Conversational Agents. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada.10.1609/aaai.v33i01.33019422 ↗
65. A comparison of methods for multiclass support vector machines10.1109/72.991427 ↗
66. Yuan, W., Ling-yu, Z., Ya-xuan, Z., Lu, H., and Ding-yi, F. (2010, January 23–24). Combining Support Vector Machines, Border Revised Rules and Transformation-based Error-driven Learning for Chinese Chunking. Proceedings of the 2010 International Conference on Artificial Intelligence and Computational Intelligence, Sanya, China.10.1109/AICI.2010.87 ↗
67. Hamada, A., Dafoulas, G., and Ismail, M. (2020, January 15–16). Intent Classification for a Management Conversational Assistant. Proceedings of the 2020 15th International Conference on Computer Engineering and Systems (ICCES), Cairo, Egypt.
68. Burges, C.J.C., Svore, K.M., Wu, Q., and Gao, J. (2008). Ranking, Boosting, and Model Adaptation, Microsoft Research. Technical Report MSR-TR-2008-109.
69. Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992). A Training Algorithm for Optimal Margin Classifiers. COLT ’92, Proceedings of the Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, PA, USA, 27–29 July 1992, Association for Computing Machinery.10.1145/130385.130401 ↗
70. He, H., and Ma, Y. (2013). Class Imbalance Learning Methods for Support Vector Machines. Imbalanced Learning: Foundations, Algorithms, and Applications, The Institute of Electrical and Electronics Engineers, Inc.