Customer Complaint Analysis via Review-Based Control Charts and Dynamic Importance–Performance Analysis
Source abstract
Abstract
Review-based control charts that integrate sentiment analysis with traditional control charts are emerging as effective tools for analyzing customer complaints. However, existing approaches face significant challenges due to their lack of alignment with the natural characteristics of online reviews, such as limited review volumes or imbalanced mentions of attributes. To address these challenges, which are commonly encountered in real-world applications, this study proposes a novel framework for review-based complaint analysis that combines a bi-level control chart with dynamic importance–performance analysis. The proposed method converts unstructured reviews into a set of statistical control charts, analyzes how the average of and variation in attribute importance and performance change over time, and identifies whether the changes are a natural event, a temporal aberration, or a gradual trend. This allows for conducting apples-to-apples quality comparison among multiple attributes and establishing appropriate improvement strategies in real-time and proactive manners. To demonstrate the applicability and effectiveness of the method, an empirical case study using online hotel reviews is presented.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Customer Service Quality and Loyalty · Sentiment Analysis and Opinion Mining · Spam and Phishing Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial and Information Systems Engineering, Soongsil University, Seoul 06978, Republic of Korea
Funding
National Research Foundation of Korea (NRF)
References (63)
Show source-provided references
1. Exploring asymmetric effects of attribute performance on customer satisfaction in the hotel industry10.1016/j.tourman.2019.104006 ↗
2. Understanding big consumer opinion data for market-driven product design10.1080/00207543.2016.1154208 ↗
3. Predicting the consumer’s purchase intention of durable goods: An attribute-level analysis10.1016/j.jbusres.2017.11.031 ↗
4. Crowd intelligence: Analyzing online product reviews for preference measurement10.1016/j.im.2015.09.010 ↗
5. Examining the influence of online reviews on consumers’ decision-making: A heuristic–systematic model10.1016/j.dss.2014.08.005 ↗
6. Measuring and comparing service quality metrics through social media analytics: A case study10.1007/s10257-017-0360-0 ↗
7. Vencovský, F. (2020, January 21–23). Service Quality Evaluation Using Text Mining: A Systematic Literature Review. Proceedings of the International Conference on Business Informatics Research, Vienna, Austria.10.1007/978-3-030-61140-8_11 ↗
8. A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis10.1186/s40537-022-00680-6 ↗
9. Mining comparative opinions from customer reviews for competitive intelligence10.1016/j.dss.2010.08.021 ↗
10. Customer complaints monitoring with customer review data analytics: An integrated method of sentiment and statistical process control analyses10.1016/j.aei.2021.101304 ↗
11. Web service quality control based on text mining using support vector machine10.1016/j.eswa.2006.09.026 ↗
12. Review-based control charts for service quality monitoring: A brief review and future directions
13. Importance-performance analysis10.1177/002224297704100112 ↗
14. Mining customer product reviews for product development: A summarization process10.1016/j.eswa.2019.04.069 ↗
15. Mining opinion components from unstructured reviews: A review
16. Trend mining for predictive product design10.1115/1.4004987 ↗
17. Min, H., Yun, J., and Geum, Y. (2018). Analyzing Dynamic Change in Customer Requirements: An Approach Using Review-Based Kano Analysis. Sustainability, 10.10.3390/su10030746 ↗
18. Social media analytics: Extracting and visualizing Hilton hotel ratings and reviews from TripAdvisor10.1016/j.ijinfomgt.2017.11.001 ↗
19. Data-Driven Approach to dual service failure monitoring from negative online reviews: Managerial perspective10.1177/2158244020988249 ↗
20. Exponentially weighted moving average control charts for monitoring customer service quality comments
21. Quantitative quality control from qualitative data: Control charts with latent semantic analysis10.1007/s11135-014-0036-5 ↗
22. Monitoring of user-generated reviews via a sequential reverse joint sentiment-topic model10.1002/qre.2452 ↗
23. George, M.L., Maxey, J., Rowlands, D.T., and Upton, M. (2004). Lean Six Sigma Pocket Toolbook, McGraw-Hill Professional Publishing.
24. Montgomery, D.C. (2009). Introduction to Statistical Quality Control, John Wiley & Sons. [6th ed.].
25. Approach for Importance–Performance Analysis of Product Attributes From Online Reviews10.1115/1.4049865 ↗
26. Wu, J., Wang, Y., Zhang, R., and Cai, J. (2018). An Approach to Discovering Product/Service Improvement Priorities: Using Dynamic Importance-Performance Analysis. Sustainability, 10.10.3390/su10103564 ↗
27. Assessing Hotel-Related Smartphone Apps Using Online Reviews
28. Nam, S., and Lee, H.C. (2019). A Text Analytics-Based Importance Performance Analysis and Its Application to Airline Service. Sustainability, 11.10.3390/su11216153 ↗
29. Social media mining for product planning: A product opportunity mining approach based on topic modeling and sentiment analysis10.1016/j.ijinfomgt.2017.09.009 ↗
30. Korean coreference resolution with guided mention pair model using deep learning10.4218/etrij.16.0115.0896 ↗
31. Research on Customer Satisfaction of Budget Hotels Based on Revised IPA and Online Reviews10.11648/j.sjbm.20200802.11 ↗
32. A review-driven customer preference measurement model for product improvement: Sentiment-based importance–performance analysis10.1007/s10257-020-00463-7 ↗
33. Chen, Y., Zhong, Y., Yu, S., Xiao, Y., and Chen, S. (2022). Exploring bidirectional performance of hotel attributes through online reviews based on sentiment analysis and Kano-IPA model. Appl. Sci., 12.10.3390/app12020692 ↗
34. A social-media-based improvement index for urban renewal10.1016/j.ecolind.2022.108775 ↗
35. Wisdom of crowds: Conducting importance-performance analysis (IPA) through online reviews10.1016/j.tourman.2018.09.010 ↗
36. Angelov, D. (2020). Top2vec: Distributed representations of topics. arXiv.
37. A review of feature extraction in sentiment analysis
38. Management and forecast of dynamic customer needs: An artificial immune and neural system approach10.1016/j.aei.2009.06.003 ↗
39. Grootendorst, M. (2022). BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv.
40. Short-text classification detector: A bert-based mental approach
41. Vencovsky, F., Lucas, B., Mahr, D., and Lemmink, J. (2017, January 3–4). Comparison of text mining techniques for service aspect extraction. Proceedings of the 4th European Conference on Social Media (ECSM), Vilnius, Lithuania.
42. Product aspect extraction supervised with online domain knowledge10.1016/j.knosys.2014.05.018 ↗
43. Sentiment analysis algorithms and applications: A survey10.1016/j.asej.2014.04.011 ↗
44. Lexicon-based methods for sentiment analysis
45. Attention-based sentiment analysis using convolutional and recurrent neural network10.1016/j.future.2020.07.022 ↗
46. Wang, J., Xu, B., and Zu, Y. (2021, January 9–11). Deep learning for aspect-based sentiment analysis. Proceedings of the 2021 International Conference on Machine Learning and Intelligent Systems Engineering (MLISE), Chongqing, China.10.1109/MLISE54096.2021.00056 ↗
47. Performance of number-between g-type statistical control charts for monitoring adverse events10.1023/A:1011806727354 ↗
48. Statistical control charts based on a geometric distribution10.1080/00224065.1992.12015229 ↗
49. Minitab, S. (2023, February 21). Select Tests for Special Causes for p Chart. Available online: https://support.minitab.com/ko-kr/minitab/21/help-and-how-to/quality-and-process-improvement/control-charts/how-to/attributes-charts/p-chart/perform-the-analysis/p-chart-options/select-tests-for-special-causes/.
50. The Shewhart control chart—Tests for special causes10.1080/00224065.1984.11978921 ↗
51. Number-between g-type statistical quality control charts for monitoring adverse events10.1023/A:1011846412909 ↗
52. Park, J. (2018). Minitab Quality Control, Eretec. [1st ed.].
53. Minitab, S. (2023, February 21). Data Considerations for g Chart. Available online: https://support.minitab.com/en-us/minitab/19/help-and-how-to/quality-and-process-improvement/control-charts/how-to/rare-event-charts/g-chart/before-you-start/data-considerations/.
54. Minitab, S. (2023, February 21). Select Tests for Special Causes for g Chart. Available online: https://support.minitab.com/en-us/minitab/19/help-and-how-to/quality-and-process-improvement/control-charts/how-to/rare-event-charts/g-chart/perform-the-analysis/g-options/select-tests-for-special-causes/.
55. Revealing the dual importance and Kano type of attributes through customer review analytics10.1016/j.aei.2022.101533 ↗
56. Naldi, M., and Petroni, S. (2023). A Testset-Based Method to Analyse the Negation-Detection Performance of Lexicon-Based Sentiment Analysis Tools. Computers, 12.10.3390/computers12010018 ↗
57. Sadia, A., Khan, F., and Bashir, F. (2018, January 21–22). An overview of lexicon-based approach for sentiment analysis. Proceedings of the 2018 3rd International Electrical Engineering Conference (IEEC 2018), Karachi, Pakistan.
58. Social context in sentiment analysis: Formal definition, overview of current trends and framework for comparison10.1016/j.inffus.2019.05.003 ↗
59. Enhancing deep learning sentiment analysis with ensemble techniques in social applications10.1016/j.eswa.2017.02.002 ↗
60. Unsupervised genre-based multidomain sentiment lexicon learning using corpus-generated polarity seed words10.1109/ACCESS.2020.3005242 ↗
61. KNU Korean sentiment lexicon: Bi-LSTM-based method for building a Korean sentiment lexicon
62. Lingua72 (2023, April 21). Korean Analyzer Rhino. Available online: https://sourceforge.net/projects/koreananalyzer/.
63. Importance-performance analysis applied to a laboratory supplies and equipment company10.1016/j.procs.2015.08.634 ↗