journal article·2019-08-12Open access

A Review of Text Corpus-Based Tourism Big Data Mining

Qin Li, Shaobo Li, Sen Zhang, Jie Hu, Jianjun Hu

Applied Sciences· Volume 9· Issue 16

Abstract

With the massive growth of the Internet, text data has become one of the main formats of tourism big data. As an effective expression means of tourists’ opinions, text mining of such data has big potential to inspire innovations for tourism practitioners. In the past decade, a variety of text mining techniques have been proposed and applied to tourism analysis to develop tourism value analysis models, build tourism recommendation systems, create tourist profiles, and make policies for supervising tourism markets. The successes of these techniques have been further boosted by the progress of natural language processing (NLP), machine learning, and deep learning. With the understanding of the complexity due to this diverse set of techniques and tourism text data sources, this work attempts to provide a detailed and up-to-date review of text mining techniques that have been, or have the potential to be, applied to modern tourism big data analysis. We summarize and discuss different text representation strategies, text-based NLP techniques for topic extraction, text classification, sentiment analysis, and text clustering in the context of tourism text mining, and their applications in tourist profiling, destination image analysis, market demand, etc. Our work also provides guidelines for constructing new tourism big data applications and outlines promising research areas in this field for incoming years.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Digital Marketing and Social Media · Diverse Aspects of Tourism Research · Sentiment Analysis and Opinion Mining

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Chengdu Institute of Computer Application, Chinese Academy of Sciences, Chengdu 610041, China

University of Chinese Academy of Sciences, Beijing 100049, China

School of Mechanical Engineering, Guizhou University, Guiyang 550025, China

Guizhou Provincial Key Laboratory of Public Big Data (Guizhou University), Guiyang, Guizhou 550025, China

College of Big Data Statistics, GuiZhou University of Finance and Economics, Guiyang, Guizhou 550025, China

Department of Computer Science and Engineering, University of South Carolina, Columbia, SC 29208, USA

Funding

National Natural Science Foundation of China · Science and Technology Project of Guizhou Province · Collaborative Innovation

References (100+)

Show source-provided references
1. The influence of user-generated content on traveler behavior: An empirical investigation on the effects of e-word-of-mouth to hotel online bookings10.1016/j.chb.2010.04.014 ↗
2. Li, Q., Li, S., Hu, J., Zhang, S., and Hu, J. (2018). Tourism Review Sentiment Classification Using a Bidirectional Recurrent Neural Network with an Attention Mechanism and Topic-Enriched Word Vectors. Sustainability, 10.10.3390/su10093313 ↗
3. Identifying Customer Preferences about Tourism Products Using an Aspect-based Opinion Mining Approach10.1016/j.procs.2013.09.094 ↗
4. Knowledge mining and visualizing for scenic spots with probabilistic topic model
5. Topic mining of tourist attractions based on a seasonal context aware LDA model10.3233/IDA-173364 ↗
6. Al-Horaibi, L., and Khan, M.B. (2016, January 11–13). Sentiment analysis of Arabic tweets using text mining techniques. Proceedings of the First International Workshop on Pattern Recognition, Tokyo, Japan.10.1117/12.2242187 ↗
7. Knowledge sharing among tourists via social media: A comparison between Facebook and TripAdvisor10.1002/jtr.2090 ↗
8. Wang, J., Li, S., and Zhou, G. (2017, January 19–25). Joint Learning on Relevant User Attributes in Micro-blog. Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia.10.24963/ijcai.2017/577 ↗
9. Gu, H., Wang, J., Wang, Z., Zhuang, B., and Su, F. (2018, January 23–27). Modeling of User Portrait Through Social Media. Proceedings of the 2018 IEEE International Conference on Multimedia and Expo (ICME), San Diego, CA, USA.10.1109/ICME.2018.8486595 ↗
10. Wang, J., Li, S., Jiang, M., Wu, H., and Zhou, G. (2018, January 21–25). Cross-media User Profiling with Joint Textual and Social User Embedding. Proceedings of the 27th International Conference on Computational Linguistics, Santa Fe, NM, USA.
11. Pennacchiotti, M., and Popescu, A. (2011, January 17–21). A Machine Learning Approach to Twitter User Classification. Proceedings of the International Conference on Weblogs and Social Media, Barcelona, Spain.
12. Zhao, K., Cong, G., Yuan, Q., and Zhu, K.Q. (2015, January 13–17). SAR: A Sentiment-aspect-region Model for User Preference Analysis in Geo-tagged Reviews. Proceedings of the 2015 IEEE 31st International Conference on Data Engineering, Seoul, Korea.10.1109/ICDE.2015.7113324 ↗
13. Application of text mining techniques to the analysis of discourse in eWOM communications from a gender perspective10.1016/j.techfore.2017.12.018 ↗
14. Škrlj, B., Martinc, M., Kralj, J., Lavrač, N., and Pollak, S. (2019). tax2vec: Constructing Interpretable Features from Taxonomies for Short Text Classification. arXiv.
15. Matching user accounts based on user generated content across social networks10.1016/j.future.2018.01.041 ↗
16. Analyzing destination branding and image from online sources: A web content mining approach10.1016/j.jbusres.2015.01.011 ↗
17. Mining meaning from online ratings and reviews: Tourist satisfaction analysis using latent dirichletallocation10.1016/j.tourman.2016.09.009 ↗
18. Wang, Y. (2016). More Important than Ever: Measuring Tourist Satisfaction, Griffith Institute for Tourism, Griffith University.
19. Kim, K., Park, O., Yun, S., and Yun, H. (2017). What makes tourists feel negatively about tourism destinations? Application of hybrid text mining methodology to smart destination management. Technol. Forecast. Soc. Chang., 123.10.1016/j.techfore.2017.01.001 ↗
20. Projected destination image online: Website content analysis of pictures and text10.3727/1098305054517327 ↗
21. Travel blogs on China as a destination image formation agent: A qualitative analysis using Leximancer10.1016/j.tourman.2014.07.012 ↗
22. Ren, G., and Hong, T. (2017). Investigating Online Destination Images Using a Topic-Based Sentiment Analysis Approach. Sustainability, 9.10.3390/su9101765 ↗
23. Rodrigues, A.I., Correia, A., Kozak, M., and Tuohino, A. (2015). Lake-destination image attributes: Content analysis of text and pictures. Marketing Places and Spaces, Emerald Group Publishing Limited.10.1108/S1871-317320150000010022 ↗
24. Yuan, H., Xu, H., Qian, Y., and Ye, K. (2014, January 14). Towards Summarizing Popular Information from Massive Tourism Blogs. Proceedings of the IEEE International Conference on Data Mining Workshop, Shenzhen, China.10.1109/ICDMW.2014.29 ↗
25. Make your travel smarter: Summarizing urban tourism information from massive blog data10.1016/j.ijinfomgt.2016.02.009 ↗
26. Mikolov, T., Chen, K., Corrado, G., and Dean, J. (2013). Efficient Estimation of Word Representations in Vector Space. arXiv.
27. Mikolov, T., Sutskever, I., and Chen, K. (2013, January 5–10). Distributed Representations of Words and Phrases and their Compositionality. Proceedings of the International Conference on Neural Information Processing Systems, Lake Tahoe, CA, USA.
28. Pennington, J., Socher, R., and Manning, C.D. (2014, January 25–29). Glove: Global Vectors for Word Representation. Proceedings of the Empirical Methods in Natural Language Processing, Doha, Qatar.10.3115/v1/D14-1162 ↗
29. McCann, B., Bradbury, J., Xiong, C., and Socher, R. (2017, January 4–9). Learned in translation: Contextualized word vectors. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
30. Deep contextualized word representations
31. Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I. (2018, June 07). Improving language understanding by generative pre-training. Available online: https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/languageunsupervised/language understanding paper.pdf.
32. Devlin, J., Chang, M., Lee, K., and Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv.
33. The Development of Topic Models in Natural Language Processing10.3724/SP.J.1016.2011.01423 ↗
34. Kim, Y. (2014). Convolutional Neural Networks for Sentence Classification. Empir. Methods Nat. Lang. Process., 1746–1751.10.3115/v1/D14-1181 ↗
35. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., and Hovy, E. (2016, January 13–15). Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1174 ↗
36. Text Clustering Algorithms: A Review
37. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the Advances in neural information processing systems, Long Beach, CA, USA.
38. A systematic literature review: Opinion mining studies from mobile app store user reviews10.1016/j.jss.2016.11.027 ↗
39. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement10.1186/2046-4053-4-1 ↗
40. Keele, S. (2007). Guidelines for Performing Systematic Literature Reviews in Software Engineering, EBSE. Technical Report Ver. 2.3 EBSE Technical Report.
41. A neural probabilistic language model
42. Qiao, C., Huang, B., Niu, G., Li, D., Dong, D., He, W., Yu, D., and Wu, H. (May, January 30). A New Method of Region Embedding for Text Classification. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada.
43. Towards Twitter sentiment classification by multi-level sentiment-enriched word embeddings10.1016/j.neucom.2017.11.023 ↗
44. Xiong, S. (2016). Improving Twitter Sentiment Classification via Multi-Level Sentiment-Enriched Word Embeddings. arXiv.
45. Bag of Tricks for Efficient Text Classification
46. Ji, S., Yun, H., Yanardag, P., Matsushima, S., and Vishwanathan, S.V.N. (2015). WordRank: Learning Word Embeddings via Robust Ranking. Comput. Sci., 658–668.10.18653/v1/D16-1063 ↗
47. Howard, J., and Ruder, S. (2018). Universal language model fine-tuning for text classification. arXiv.10.18653/v1/P18-1031 ↗
48. Le, Q.V., and Mikolov, T. (2014, January 21–26). Distributed Representations of Sentences and Documents. Proceedings of the International Conference on International Conference on Machine Learning, Beijing, China.
49. Arora, S., Liang, Y., and Ma, T. (2017, January 24–26). A Simple but Tough-to-Beat Baseline for Sentence Embeddings. Proceedings of the International Conference on Learning Representations, Toulon, France.
50. Kiros, R., Zhu, Y., Salakhutdinov, R.R., Zemel, R., Urtasun, R., Torralba, A., and Fidler, S. (2015, January 7–12). Skip-thought vectors. Proceedings of the Advances in Neural Information Processing Systems, Montreal, Canada.
51. Logeswaran, L., and Lee, H. (2018). An efficient framework for learning sentence representations. arXiv.
52. Conneau, A., Kiela, D., Schwenk, H., Barrault, L., and Bordes, A. (November, January 31). Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.
53. Subramanian, S., Trischler, A., Bengio, Y., and Pal, C. (May, January 30). Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning. Proceedings of the International Conference on Learning Representations, Vancouver, Canada.
54. Liu, G., Xu, X., Zhu, Y., and Li, L. (2014, January 3–5). An Improved Latent Dirichlet Allocation Model for Hot Topic Extraction. Proceedings of the IEEE Fourth International Conference on Big Data and Cloud Computing, Sydney, Australia.10.1109/BDCloud.2014.55 ↗
55. What do hotel customers complain about? Text analysis using structural topic model10.1016/j.tourman.2019.01.002 ↗
56. Structural topic models for open ended survey responses10.1111/ajps.12103 ↗
57. Mining user interests over active topics on social networks10.1016/j.ipm.2017.12.003 ↗
58. Rana, T.A., and Cheah, Y.N. (2016). Aspect extraction in sentiment analysis: Comparative analysis and survey. Artif. Intell. Rev., 1–25.10.1007/s10462-016-9472-z ↗
59. Rose, S., Engel, D., Cramer, N., and Cowley, W. (2010). Automatic Keyword Extraction from Individual Documents. Text Min. Appl. Theory, 1–20.10.1002/9780470689646.ch1 ↗
60. Bougouin, A., Boudin, F., and Daille, B. (2013, January 14–18). TopicRank: Graph-Based Topic Ranking for Keyphrase Extraction. Proceedings of the International Joint Conference on Natural Language Processing, Nagoya, Japan.
61. Using Word2vec with TextRank to Extract Keywords
62. Xun, G., Li, Y., Zhao, W.X., Gao, J., and Zhang, A. (2017, January 19–25). A Correlated Topic Model Using Word Embeddings. Proceedings of the International Joint Conference on Artificial Intelligence, Melbourne, Australian.10.24963/ijcai.2017/588 ↗
63. Joint multi-grain topic sentiment: Modeling semantic aspects for online reviews10.1016/j.ins.2016.01.013 ↗
64. Mining coherent topics in documents using word embeddings and large-scale text data10.1016/j.engappai.2017.06.024 ↗
65. Moody, C.E. (2016). Mixing dirichlet topic models and word embeddings to make lda2vec. arXiv.
66. Wang, Z., Ma, L., and Zhang, Y. (2016, January 13–16). A hybrid document feature extraction method using latent Dirichlet allocation and word2vec. Proceedings of the 2016 IEEE First International Conference on Data Science in Cyberspace (DSC), Changsha, China.10.1109/DSC.2016.110 ↗
67. Cao, Z., Li, S., Liu, Y., Li, W., and Ji, H. (2015, January 25–30). A novel neural topic model and its supervised extension. Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, Austin, TX, USA.10.1609/aaai.v29i1.9499 ↗
68. Lau, J.H., Baldwin, T., and Cohn, T. (2017). Topically driven neural language model. arXiv.10.18653/v1/P17-1033 ↗
69. He, R., Lee, W.S., Ng, H.T., and Dahlmeier, D. (August, January 30). An Unsupervised Neural Attention Model for Aspect Extraction. Proceedings of the Meeting of the Association for Computational Linguistics, Vancouver, BC, Canada.
70. Qiu, L., and Yu, J. (2018). CLDA: An effective topic model for mining user interest preference under big data background. Complexity, 2018.10.1155/2018/2503816 ↗
71. Corpus-based topic diffusion for short text clustering10.1016/j.neucom.2017.11.019 ↗
72. Exploring coherent topics by topic modeling with term weighting10.1016/j.ipm.2018.05.009 ↗
73. Extracting topic-sensitive content from textual documents—A hybrid topic model approach10.1016/j.engappai.2017.12.010 ↗
74. Hierarchical topic modeling with automatic knowledge mining10.1016/j.eswa.2018.03.008 ↗
75. Fuzzy Aspect Based Opinion Classification System for Mining Tourist Reviews10.1155/2016/6965725 ↗
76. Toward optimal feature selection in naive Bayes for text categorization10.1109/TKDE.2016.2563436 ↗
77. Hamzah, A., and Widyastuti, N. (2016, January 12). Opinion classification using maximum entropy and K-means clustering. Proceedings of the 2016 International Conference on Information & Communication Technology and Systems (ICTS), Surabaya, Indonesia.10.1109/ICTS.2016.7910292 ↗
78. Turning from TF-IDF to TF-IGM for term weighting in text classification10.1016/j.eswa.2016.09.009 ↗
79. An, J., and Chen, Y.P. (2005, January 19–21). Keyword extraction for text categorization. Proceedings of the Active Media Technology, Kagawa, Japan.
80. Hu, J., Li, S., Yao, Y., Yu, L., Yang, G., and Hu, J. (2018). Patent keyword extraction algorithm based on distributed representation for patent classification. Entropy, 20.10.3390/e20020104 ↗
81. Hu, J., Li, S., Hu, J., and Yang, G. (2018). A Hierarchical Feature Extraction Model for Multi-Label Mechanical Patent Classification. Sustainability, 10.10.3390/su10010219 ↗
82. N-gram Based Text Categorization Method for Improved Data Mining
83. Improving short text classification by learning vector representations of both words and hidden topics10.1016/j.knosys.2016.03.027 ↗
84. Zhang, X., Zhao, J.J., and Lecun, Y. (2015). Character-level convolutional networks for text classification. Neural Inf. Process. Syst., 649–657.
85. DeepPatent: Patent classification with convolutional neural networks and word embedding10.1007/s11192-018-2905-5 ↗
86. Zhou, P., Qi, Z., Zheng, S., Xu, J., Bao, H., and Xu, B. (2016). Text Classification Improved by Integrating Bidirectional LSTM with Two-dimensional Max Pooling. Int. Conf. Comput. Ling., 3485–3495.
87. Lai, S., Xu, L., Liu, K., and Zhao, J. (2015, January 25–30). Recurrent convolutional neural networks for text classification. Proceedings of the 29th AAAI Conference on Artificial Intelligence, Austin, TX, USA.10.1609/aaai.v29i1.9513 ↗
88. Sainath, T.N., Vinyals, O., Senior, A., and Sak, H. (2015, January 19–24). Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Brisbane, QLD, Australia.10.1109/ICASSP.2015.7178838 ↗
89. Liu, P., Qiu, X., and Huang, X. (2016). Recurrent neural network for text classification with multi-task learning. arXiv.
90. Conneau, A., Schwenk, H., Barrault, L., Lecun, Y., Conneau, A., Schwenk, H., Barrault, L., and Lecun, Y. (2016). Very Deep Convolutional Networks for Text Classification. Comput. Sci., 1107–1116.10.18653/v1/E17-1104 ↗
91. Vertical Ensemble Co-Training for Text Classification
92. A Sample Extension Method Based on Wikipedia and Its Application in Text Classification10.1007/s11277-018-5416-z ↗
93. Jiang, X., Havaei, M., Chartrand, G., Chouaib, H., Vincent, T., Jesson, A., Chapados, N., and Matwin, S. (2018). On the Importance of Attention in Meta-Learning for Few-Shot Text Classification. arXiv.
94. Merity, S., Keskar, N.S., and Socher, R. (2017). Regularizing and optimizing LSTM language models. arXiv.
95. Zheng, X., Luo, Y., Sun, L., Ji, Z., and Chen, F. (2018). A tourism destination recommender system using users’ sentiment and temporal dynamics. J. Intell. Inf. Syst., 1–22.10.1007/s10844-018-0496-5 ↗
96. Serna, A., Gerrikagoitia, J.K., Bernabe, U., and Ruiz, T. (2017, January 24–26). A Method to Assess Sustainable Mobility for Sustainable Tourism: The Case of the Public Bike Systems. Proceedings of the Enter Conference | Etourism: Sustaining Culture & Creativity Organized by International Federation for Information Technology & Travel & Tourism, Rome, Italy.10.1007/978-3-319-51168-9_52 ↗
97. VisTravel: Visualizing tourism network opinion from the user generated content10.1007/s12650-015-0330-x ↗
98. Zong, C. (2013). Statistical Natural Language Processing, Tsinghua University Press.
99. Sentiment Analysis10.3724/SP.J.1001.2010.03832 ↗
100. Combining Convolutional Neural Networks and Word Sentiment Sequence Features for Chinese Text Sentiment Analysis