LDA-Based Topic Modeling Sentiment Analysis Using Topic/Document/Sentence (TDS) Model
Source abstract
Abstract
Customer reviews on the Internet reflect users’ sentiments about the product, service, and social events. As sentiments can be divided into positive, negative, and neutral forms, sentiment analysis processes identify the polarity of information in the source materials toward an entity. Most studies have focused on document-level sentiment classification. In this study, we apply an unsupervised machine learning approach to discover sentiment polarity not only at the document level but also at the word level. The proposed topic document sentence (TDS) model is based on joint sentiment topic (JST) and latent Dirichlet allocation (LDA) topic modeling techniques. The IMDB dataset, comprising user reviews, was used for data analysis. First, we applied the LDA model to discover topics from the reviews; then, the TDS model was implemented to identify the polarity of the sentiment from topic to document, and from document to word levels. The LDAvis tool was used for data visualization. The experimental results show that the analysis not only obtained good topic partitioning results, but also achieved high sentiment analysis accuracy in document- and word-level sentiment classifications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Sentiment Analysis and Opinion Mining · Advanced Text Analysis Techniques · Text and Document Classification Technologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of IT Convergence Engineering, Gachon University, Sujeong-Gu, Seongnam-Si 461-701, Gyeonggi-Do, Korea
Department of Computer Engineering, Gachon University, Sujeong-Gu, Seongnam-Si 461-701, Gyeonggi-Do, Korea
References (41)
Show source-provided references
1. Indurkhya, N., and Damerau, F.J. (2010). Sentiment Analysis and Subjectivity. Handbook of Natural Language Processing, MIT Press. [2nd ed.].10.1201/9781420085938 ↗
2. Martínez Cámara, E., Almeida-Cruz, Y., Díaz Galiano, M.C., Estévez-Velarde, S., García Cumbreras, M.Á., García Vega, M., Gutiérrez, Y., Montejo Ráez, A., Montoyo, A., and Munoz, R. (2018). Overview of TASS: Opinions, Health and Emotions. TASS 2018 Workshop on Sentiment Analysis as SEPLN, CEUR Workshop.
3. Sentiment analysis in Twitter10.1017/S1351324912000332 ↗
4. Ho, V.A., Nguyen, D.H.-C., Nguyen, D.H., Pham, L.T.-V., Nguyen, D.-V., van Nguyen, K., and Nguyen, N.L.-T. (2019, January 11–13). Emotion Recognition for Vietnamese Social Media Text. Proceedings of the 2019 International Conference of the Pacific Association for Computational Linguistics (PACLING 2019), Hanoi, Vietnam.
5. Liu, B., Indurkhya, N., and Damerau, F.J. (2010). Handbook of Natural Language Processing, Chapman & Hall. [2nd ed].10.1201/9781420085938 ↗
6. Opinion mining and sentiment analysis10.1561/1500000011 ↗
7. Sentiment analysis and opinion mining
8. Sentiment analysis algorithms and applications: A survey10.1016/j.asej.2014.04.011 ↗
9. Maynard, D., and Funk, A. (2011, January 29–30). Automatic detection of political opinions in tweets. Proceedings of the 8th International Conference on the Semantic Web, ESWC’11, Heraklion, Greece.
10. Survey on the mining subjective data on the web10.1007/s10618-011-0238-6 ↗
11. A survey on sentiment analysis of scientific citations10.1007/s10462-017-9597-8 ↗
12. Ortis, A., Farinella, G.M., and Battiato, S. (2019, January 26–28). An Overview on Image Sentiment Analysis: Methods, Datasets and Current Challenges. Proceedings of the 16th International Joint Conference on e-Business and Telecommunications, ICETE 2019, Prague, Czech Republic.10.5220/0007909602900300 ↗
13. Siersdorfer, S., Minack, E., Deng, F., and Hare, J. (2010, January 25–29). Analyzing and predicting sentiment of images on the social web. Proceedings of the 18th ACM International Conference on Multimedia, ACM, Firenze, Italy.10.1145/1873951.1874060 ↗
14. Doshi, U., Barot, V., and Gavhane, S. (2020, January 18–20). Emotion Detection and Sentiment Analysis of Static Images. Proceedings of the 2020 International Conference on Convergence to Digital World—Quo Vadis (ICCDW), Mumbai, India.10.1109/ICCDW45521.2020.9318713 ↗
15. Noh, Y., Park, S., and Park, S.-B. (2019). Aspect-Based Sentiment Analysis Using Aspect Map. Appl. Sci., 9.10.3390/app9163239 ↗
16. Toward multi-label sentiment analysis: A transfer learning based approach10.1186/s40537-019-0278-0 ↗
17. Abdelgwad, M.M., Soliman, T.H.A., Taloba, A.I., and Farghaly, M.F. (2021). Arabic aspect based sentiment analysis using bidirectional gru based models. arXiv.
18. Sentiment polarity detection in Spanish reviews combining supervised and unsupervised approaches10.1016/j.eswa.2012.12.084 ↗
19. How to Improve Text Summarization and Classification by Mutual Cooperation on an Integrated Framework10.1016/j.eswa.2016.05.001 ↗
20. Turney, P.D., and Littman, M.L. (2002). Unsupervised learning of semantic orientation from a hundred-billion-word corpus. arXiv.
21. Lin, C., and He, Y. (2017, January 6–10). Joint Sentiment/Topic Model for Sentiment Analysis. Proceedings of the 18th ACM Conference on Information and Knowledge Management, Singapore.
22. Duric, A., and Song, F. (2011, January 24). Feature selection for sentiment analysis based on content and syntax models. Proceedings of the 2nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (WASSA ’11), Portland, OR, USA.
23. Unsupervised Methods to Improve Aspect-Based Sentiment Analysis in Czech
24. Aspect-Based Sentiment Analysis Using Semi-Supervised Learning in Bipartite Heterogeneous Networks
25. Pannala, N.U., Nawarathna, C.P., Jayakody, J.T.K., Rupasinghe, L., and Krishnadeva, K. (2016, January 8–10). Supervised Learning Based Approach to Aspect Based Sentiment Analysis. Proceedings of the 2016 IEEE International Conference on Computer and Information Technology (CIT), Nadi, Fiji.10.1109/CIT.2016.107 ↗
26. Chakraborti, S., Lothian, R., Wiratunga, N., and Watt, S. (2006, January 10–12). Sprinkling: Supervised Latent Semantic Indexing. Proceedings of the 28th European Conference on Advances in Information Retrieval, London, UK.10.1007/11735106_53 ↗
27. (2021, August 10). IMDB Dataset. Available online: https://www.kaggle.com/lakshmi25npathi/imdb-dataset-of-50k-movie-reviews.
28. Sievert, C., and Shirley, K.E. (2014, January 27). LDAvis: A method for visualizing and interpreting topics. Proceedings of the Workshop on Interactive Language Learning, Visualization, and Interfaces, Baltimore, MD, USA.10.3115/v1/W14-3110 ↗
29. Latent dirichlet allocation
30. Latent Dirichlet Allocation (LDA) and Topic modeling: Models, application, a survey10.1007/s11042-018-6894-4 ↗
31. Agarwal, A., Xie, B., Vovsha, I., Rambow, O., and Passonneau, R.J. (2011, January 23). Sentiment Analysis of Twitter Data. Proceedings of the Workshop on Language in Social Media (LSM 2011), Portland, Oregon.
32. Bauer, S., Noulas, A., Séaghdha, D.O., Clark, S., and Mascolo, C. (2012, January 3–5). Talking places: Modelling and analyzing linguistic content in foursquare. Proceedings of the 2012 International Conference on Social Computing (SocialCom), Amsterdam, The Netherlands.10.1109/SocialCom-PASSAT.2012.107 ↗
33. Eidelman, V., Boyd-Graber, J., and Resnik, P. (2012, January 8–14). Topic models for dynamic translation model adaption. Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Jeju Island, Korea.
34. Godin, F., Slavkovikj, V., De Neve, W., Schrauwen, B., and Van de Walle, R. (2013, January 13–17). Using topic models for twitter hashtag recommendation. Proceedings of the 22nd International Conference on World Wide Web, ACM, Rio de Janeiro, Brazil.10.1145/2487788.2488002 ↗
35. Mukherjee, S., Basu, G., and Joshi, S. (2014, January 24–26). Joint Author Sentiment Topic Model. Proceedings of the 2014 SIAM International Conference on Data Mining, Philadelphia, PA, USA.10.1137/1.9781611973440.43 ↗
36. Rajaraman, A., and Ullman, J.D. (2011). Mining of Massive Datasets, Cambridge University Press.10.1017/CBO9781139058452 ↗
37. Improving the Performance of Sentiment Analysis of tweets containing fuzzy sentiment using the feature ensemble model10.1109/ACCESS.2019.2963702 ↗
38. Integrating Intra-and Inter-document Evidences for Improving Sentence Sentiment Classification10.3724/SP.J.1004.2010.01417 ↗
39. Sahlgren, M., and Cöster, R. (2004, January 23–27). Using bag-of-concepts to improve the performance of support vector machines in text categorization. Proceedings of the 20th International Conference on Computational Linguistics (COLING ’04), Geneva, Switzerland.10.3115/1220355.1220425 ↗
40. Kim, Y. (2014, January 25–29). Convolutional Neural Networks for Sentence Classification. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing, Doha, Qatar.10.3115/v1/D14-1181 ↗
41. Zheng, W., Liu, X., and Yin, L. (2021). Sentence Representation Method Based on Multi-Layer Semantic Network. Appl. Sci., 11.10.3390/app11031316 ↗