journal article·2023-06-26Open access

Research Practice and Progress of Models and Algorithms Applied in Topic Identification and Prediction Based on the Analysis of CNKI

Sicheng Guo, Li Si, Xianrui Liu

Applied Sciences· Volume 13· Issue 13

Abstract

As a hot topic in the field of library and information, the research on topic recognition and trend prediction has been paid close attention by academic circles. This paper uses a systematic literature review, bibliometric analyses and classification methods. Through a systematic literature review, 96 studies about topic identification and evolution prediction models are selected from the CNKI database. By using VOSviewer to conduct bibliometric analyses, the key research content and themes are revealed. Through the classification method, EXCEL is used to summarize models and algorithms used in the literature comprehensively. It is found that topic identification models and algorithms can be divided into four categories: ① Topic model based on LDA and related derivative models. ② Machine learning and deep learning methods. ③ Methods based on reference relation. ④ Text mining methods. Trend prediction models and algorithms mainly cover two categories: ① deep learning or machine learning models and algorithms based on time sequence; ② link prediction algorithms based on complex network. At the same time, we have also summarized the common index system involved in each study and the way to evaluate the effectiveness of the method, thus this paper comprehensively reveals the application progress in academic circles of topic identification and prediction models and algorithms from the last 10 years and beyond, based on the CNKI database. The purpose is to determine the most popular models and algorithms applied in research, generalize the corresponding indicator systems and validation methods, and finally provide references for model choice or evaluation when identifying and predicting topics in the future. Thus, this paper can help us to understand the overall progress made in text analysis research, and provides a useful reference for selecting and applying the appropriate models, algorithms and indicators.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Text Analysis Techniques · Computational and Text Analysis Methods · scientometrics and bibliometrics research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information Management, Wuhan University, Wuhan 430072, China

Center for Studies of Information Resources, Wuhan University, Wuhan 430072, China

References (100+)

Show source-provided references
1. Research on the Evolution and Prediction of Knowledge Topic
2. Research Review on Emerging Topic Identification Based on Scientific Literatures
3. Evolution Analysis of Hot Topics with Trend-Prediction
4. Zheng, X.Q. (2019). Research on System Construction Based on Emerging Topic Detection and Prediction Method, Xiamen University.
5. Identifying Technology Innovation Opportunities Based on GTM Reverse Mapping
6. Research on the Prediction Method of Related Topics in the Medical Field Based on Social Media
7. A study on the classification of universities based on discipline characteristics: An example of “double first-class” universities
8. Stability of feature selection algorithm: A review
9. Evolution Analysis and Prediction of Scientific Topic Popularity in the Field of LIS
10. Research Progress of Scientific and Technical Literature Topic Detection and Evolution Based on Topic Model in China
11. Survey of Disruptive Technology Identification
12. Research Progress of Disruptive Technical Identification Indicators
13. The Identification of Disruptive Technology from a Multi-dimensional Perspective: Research Progress and Future Prospects
14. Hot topic detection in central bankers’ speeches10.1016/j.eswa.2023.120563 ↗
15. Tracing the evolution of service robotics: Insights from a topic modeling approach10.1016/j.techfore.2021.121280 ↗
16. Review on Topic Discovery Methods Based on Text Clustering
17. Progress on Methods of Emerging Technology Topics Identification
18. Urban flood numerical simulation: Research, methods and future perspectives10.1016/j.envsoft.2022.105478 ↗
19. Qualitative research methods in chronic disease: Introduction and opportunities to promote health equity10.1146/annurev-publhealth-012420-105104 ↗
20. Mechanism, influencing factors and research methods for soil desiccation cracking: A review
21. Review on Technology Evolution Research from Patent Citation Perspective
22. Literature Review of Quantitative Technology Foresight Methods Based on Topic Modeling
23. Review on Disruptive Technology Discovery Methods
24. Progress of Approaches for Identification and Forecasting of Disruptive Technologies
25. Reviewing machine learning of corrosion prediction in a data-oriented perspective10.1038/s41529-022-00218-4 ↗
26. Guidelines and quality criteria for artificial intelligence-based prediction models in healthcare: A scoping review10.1038/s41746-021-00549-7 ↗
27. Identifying Topics of Online Healthcare Reviews Based on Improved LDA
28. Scientific Frontier Prediction Model Based on Support Vector Machine and Improved Particle Swarm Optimization
29. Research on Interdisciplinary Topics Identification
30. Patent Frontier Technology Topic Identification and Trend Prediction
31. How to do a systematic review: A best practice guide for conducting and reporting narrative reviews, meta-analyses, and meta-syntheses10.1146/annurev-psych-010418-102803 ↗
32. A bibliometric analysis of social entrepreneurship10.1016/j.jbusres.2015.10.033 ↗
33. Co-citation in the scientific literature: A new measure of the relationship between two documents10.1002/asi.4630240406 ↗
34. Bellis, N.D. (2009). Bibliometrics and Citation Analysis: From the Science Citation Index to Cyber-Metrics, Scarecrow Press.
35. Deep Learning: A comprehensive overview on techniques, taxonomy, applications and research directions10.1007/s42979-021-00815-1 ↗
36. Research on Topic Relation and Prediction Based on LDA and LSTM
37. Prediction and Visualization of Emerging Topics of Fund Sponsored Projects Based on Time Series Analysis and SVM Model
38. Topic Discovery and Evolution Analysis of Digital Journalism
39. Analysis of the Evolutionary Trend of Technical Topics in Patents Based on LDA and HMM
40. Thematic Trend Prediction of Information Architecture Based on the ARIMA Model
41. The Research and Implementation of Topic Evolution Based on LDA
42. Topic Discovery and Trend Forecasting in the Science and Technology Literature
43. Research on Topic Model Based Patent Mining and Its Applications
44. Study of text evolution analysis and prediction based on topic model
45. Radical Innovative Topic Identification from a Perspective of Dynamic Topic Network
46. Research on Lagging Effect of Topic Diffusion Evolution Face to Prediction of Research Front
47. Finding Collaboration Opportunities from Emerging Issues with LDA Topic Model and Link Prediction
48. Research on Topic Recognition of Key Core Technology in Industrial Chain Based on Multi-source Information Fusion
49. Topic Extraction and Evolution for Scientific Literature Based on Hierarchical Probabilistic Topic Model
50. Research on Topic Heat Prediction Based on VOLDA Theme Model and ESG Prediction Model
51. Research on Topic Discovery and Evolutive Prediction and Its Application Based on Scientific and Technical Literature
52. Research on Technology Forecasting Method from the Perspective of Data Fusion
53. Technology Topic Prediction Research Based on LSTM
54. Technology Prediction Based on Core Patents Technology Topic Recognition and Evolution Analysis
55. Topic Identification and Evolution Path Analysis of Social Appeal Based on Dynamic Semantic Dependency Network
56. Research on Technology Fronts Prediction Based on Patent IPC Classification and Text Information
57. Research on the Evolution Path of Industrial Wastewater Treatment Technology Based on Patent Mining
58. Research on Topic Identification Technology of Emerging Technology in the Ship Field
59. Research on Key Technology Forecasting Based on Intelligent Methods
60. Research Technology Evolution Analysis Method Oriented on Patent
61. Topic Identification of Highly Cited Papers Based on Citation Content Analysis
62. Identifying Innovation Topic Within the Relevancy Between Texts and Citations
63. Research on Identification Method of Disruptive Technology Based on Patent and Bass Model
64. Research on Disruptive Technology Identification Based on Patent Citation Changes
65. Research on Disruptive Technology Identification Methods from the Perspective of Technology Discontinuities
66. Multiple-pattern Analysis and Prediction of Topic Evolution Path Based on Topic Correlation
67. Research on Scientific Topic Evolution and Forecasting
68. Research on Technology Forecasting Based on Trend Evolution Analysis
69. Research on the Evolution of Technological Relatedness Trends Based on Patent Codes Co-Occurrence
70. Topic Recognition and Feature Analysis about the Researches in the Field of Intelligent Technology
71. A Semantic Mining-Based Method to Analyze and Evaluate Technology Innovation Pathway
72. Early Identification of Disruptive Technology Based on Multi-Source Heterogeneous Data
73. Technology Evolution Analysis Based on Patent Elements Features
74. Research on Core Technology Topic Identification and Evolution Trend Analysis Based on Semantic Information
75. Research on the Methods of Identifying and Analyzing Potential Disruptive Technologies from the Perspective of Catastrophe
76. The Popularity Prediction of Scientific Topics Based on LSTM
77. Research on Key Generic Technology Identification and Foresight Based on Patent Data Mining
78. A Method for Development Hierarchy Division and Trend Prediction of Subject Research Topic
79. Research on Topic Discovery and Evolution Based on Time Series Clustering
80. Prediction of Hot Trends in Animal Genetics and Breeding Based on Machine Learning
81. Research on Technology Trend Prediction Method Based on Word Vector
82. Applying Text Mining to Technology Opportunities Analysis in Biomedical Field
83. Research on Identification of Emerging Topics Based on Link Prediction with Weighted Networks
84. Technology Prediction Method Based on Data Fusion and Life Cycle
85. Study on Radical Innovation Prediction to Emerging Technology Topics Based on Citation Curve Fitting
86. Research on Multi-dimensional Interdisciplinary Topics Identification Method Based on Scientific Literature Contents Analysis
87. Research on the Method of Disruptive Technology Identification Based on Patent Bibliometrics
88. Development Forecast of Core Theme in Science and Technology Field Based on Trend Analysis
89. Technology Forecast Based on Deep Learning
90. Text analytics of customers on twitter: Brand sentiments in customer support
91. A review of COVID-19 biomarkers and drug targets: Resources and tools10.1093/bib/bbaa328 ↗
92. Research on the Technical Theme and its Technical Principle of Intelligent Security Technology from the Perspective of Patent Literature
93. Relational intelligence recognition in online social networks—A survey10.1016/j.cosrev.2019.100221 ↗
94. Analysis of direct citation, co-citation and bibliographic coupling in scientific topic identification10.1177/0165551520962775 ↗
95. Detecting Favorite Topics in Computing Scientific Literature via Dynamic Topic Modeling10.1109/ACCESS.2023.3269660 ↗
96. Analysis of Persian Bioinformatics Research with Topic Modeling10.1155/2023/3728131 ↗
97. Citation Topic Identification and Evolution Based on Citation Content Clustering
98. Research on Topic Detecting of Pandemic Policies of China and the United State of America Based on Embedded Topic Model
99. Hot Topic Prediction Based on Time Series
100. The Key Technology Identification Method Based on BERT-LDA and Its Empirical Research