journal article·2019-12-13Open access

Topic Predictions and Optimized Recommendation Mechanism Based on Integrated Topic Modeling and Deep Neural Networks in Crowdfunding Platforms

Wafa Shafqat, Yung-Cheol Byun

Applied Sciences· Volume 9· Issue 24

Abstract

The accelerated growth rate of internet users and its applications, primarily e-business, has accustomed people to write their comments and reviews about the product they received. These reviews are remarkably competent to shape customers’ decisions. However, in crowdfunding, where investors finance innovative ideas in exchange for some rewards or products, the comments of investors are often ignored. These comments can play a markedly significant role in helping crowdfunding platforms to battle against the bitter challenge of fraudulent activities. We take advantage of the language modeling techniques and aim to merge them with neural networks to identify some hidden discussion patterns in the comments. Our objective is to design a language modeling based neural network architecture, where Recurrent Neural Networks (RNN) Long Short-Term Memory (LSTM) is used to predict discussion trends, i.e., either towards scam or non-scam. LSTM layers are fed with latent topic distribution learned from the pre-trained Latent Dirichlet Allocation (LDA) model. In order to optimize the recommendations, we used Particle Swarm Optimization (PSO) as a baseline algorithm. This module helps investors find secure projects to invest in (with the highest chances of delivery) within their preferred categories. We used prediction accuracy, an optimal number of identified topics, and the number of epochs, as metrics of performance evaluation for the proposed approach. We compared our results with simple Neural Networks (NNs) and NN-LDA based on these performance metrics. The strengths of both integrated models suggest that the proposed model can play a substantial role in a better understanding of crowdfunding comments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: FinTech, Crowdfunding, Digital Finance · Microfinance and Financial Inclusion · Sharing Economy and Platforms

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, Jeju National University, Jeju 63243, Korea

References (68)

Show source-provided references
1. (2019, October 10). World’s Internet Users Report 2018. Available online: https://wearesocial.com/blog/2018/01/global-digital-report-2018.
2. Analysis of the perceived value of online tourism reviews: Influence of readability and reviewer characteristics10.1016/j.tourman.2015.07.018 ↗
3. (2019, October 10). Internet Crime Report 2018, Available online: https://www.fbi.gov/news/stories/ic3-releases-2018-internet-crime-report-042219.
4. Gerber, E.M., Hui, J.S., and Kuo, P.Y. (2012, January 11–15). Crowdfunding: Why people are motivated to post and fund projects on crowdfunding platforms. Proceedings of the International Workshop on Design, Influence, and Social Technologies: Techniques, Impacts and Ethics, Seattle, WA, USA.
5. (2019, October 10). Communicating Science Online Increases Interest, Engagement and Access to Funds. Available online: https://theconversation.com/communicating-science-online-increases-interest-engagement-and-access-to-funds-122102.
6. Latent dirichlet allocation
7. Peng, D., Guilan, D., and Yong, Z. (2016, January 20–22). Contextual-LDA: A Context Coherent Latent Topic Model for Mining Large Corpora. Proceedings of the IEEE Second International Conference on Multimedia Big Data (BigMM), Taipei, Taiwan.10.1109/BigMM.2016.72 ↗
8. Which updates during an equity crowdfunding campaign increase crowd participation?10.1007/s11187-017-9876-4 ↗
9. The dynamics of crowdfunding: An exploratory study10.1016/j.jbusvent.2013.06.005 ↗
10. Kuppuswamy, V., and Bayus, B.L. (2014). Crowdfunding creative ideas: The dynamics of project backers in Kickstarter. SSRN.10.2139/ssrn.2234765 ↗
11. It’s never too late: Funding dynamics and self pledges in reward-based crowdfunding10.1016/j.respol.2018.04.020 ↗
12. Kuppuswamy, V., and Bayus, B.L. (2018). Crowdfunding creative ideas: The dynamics of project backers. The Economics of Crowdfunding, Palgrave Macmillan.10.1007/978-3-319-66119-3_8 ↗
13. Marom, D., Robb, A., and Sade, O. (2016). Gender dynamics in crowdfunding (Kickstarter): Evidence on entrepreneurs, investors, deals and taste-based discrimination. SSRN.
14. Field experiments of success-breeds-success dynamics10.1073/pnas.1316836111 ↗
15. New players in entrepreneurial finance and why they are there10.1007/s11187-016-9826-6 ↗
16. Boom and gloom10.1111/jofi.12391 ↗
17. Crowdfunding: Geography, social networks, and the timing of investment decisions10.1111/jems.12093 ↗
18. Individual crowdfunding practices10.1080/13691066.2013.785151 ↗
19. Signaling in equity crowdfunding10.1111/etap.12157 ↗
20. Equity retention and social network theory in equity crowdfunding10.1007/s11187-016-9710-4 ↗
21. Li, Y., Rakesh, V., and Reddy, C.K. (2016, January 22–25). Project success prediction in crowdfunding environments. Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, San Francisco, CA, USA.10.1145/2835776.2835791 ↗
22. Greenberg, M.D., Pardo, B., Hariharan, K., and Gerber, E. (May, January 27). Crowdfunding support tools: Predicting success & failure. Proceedings of the CHI’13 Extended Abstracts on Human Factors in Computing Systems, Paris, France.
23. Chung, J., and Lee, K. (2015, January 1–4). A long-term study of a crowdfunding platform: Predicting project success and fundraising amount. Proceedings of the 26th ACM Conference on Hypertext & Social Media, Guzelyurt, Northern Cyprus.10.1145/2700171.2791045 ↗
24. Cheng, C., Tan, F., Hou, X., and Wei, Z. (2019, January 10–16). Success prediction on crowdfunding with multimodal deep learning. Proceedings of the 28th International Joint Conference on Artificial Intelligence, Macao, China.10.24963/ijcai.2019/299 ↗
25. Mitra, T., and Gilbert, E. (2014, January 15–19). The language that gets people to give: Phrases that predict success on kickstarter. Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, Baltimore, MD, USA.10.1145/2531602.2531656 ↗
26. Shafqat, W., Lee, S., Malik, S., and Kim, H.C. (2016, January 11–15). The language of deceivers: Linguistic features of crowdfunding scams. Proceedings of the 25th International Conference Companion on World Wide Web, Montréal, QC, Canada.10.1145/2872518.2889356 ↗
27. Linguistic style and crowdfunding success among social and commercial entrepreneurs10.1016/j.jbusvent.2016.11.001 ↗
28. The determinants of crowdfunding success: A semantic text analytics approach10.1016/j.dss.2016.08.001 ↗
29. Xu, A., Yang, X., Rao, H., Fu, W.T., Huang, S.W., and Bailey, B.P. (May, January 26). Show me the money: An analysis of project updates during crowdfunding campaigns. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Toronto, ON, Canada.
30. A correlated topic model of science
31. Hall, D., Jurafsky, D., and Manning, C.D. (2008, January 25–27). Studying the history of ideas using topic models. Proceedings of the Conference on Empirical Methods in Natural Language Processing, Honolulu, HI, USA.10.3115/1613715.1613763 ↗
32. Yasunaga, M., and Lafferty, J. (2019). TopicEq: A joint topic and mathematical equation model for scientific texts. arXiv.10.1609/aaai.v33i01.33017394 ↗
33. Ding, R., Nallapati, R., and Xiang, B. (2018). Coherence-Aware Neural Topic Modeling. arXiv.10.18653/v1/D18-1096 ↗
34. Larochelle, H., and Lauly, S. (2012, January 3–6). A neural autoregressive topic model. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, NV, USA.
35. Miao, Y., Yu, L., and Blunsom, P. (2016, January 19–24). Neural variational inference for text processing. Proceedings of the International Conference on Machine Learning, New York, NY, USA.
36. Miao, Y., Grefenstette, E., and Blunsom, P. (2017, January 6–11). Discovering discrete latent topics with neural variational inference. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
37. Mikolov, T., Karafiát, M., Burget, L., Černocký, J., and Khudanpur, S. (2010, January 26–30). Recurrent neural network-based language model. Proceedings of the Eleventh Annual Conference of the International Speech Communication Association, Makuhari, Chiba, Japan.10.21437/Interspeech.2010-343 ↗
38. Jozefowicz, R., Vinyals, O., Schuster, M., Shazeer, N., and Wu, Y. (2016). Exploring the limits of language modeling. arXiv.
39. Messina, R., and Louradour, J. (2015, January 23–26). Segmentation-free handwritten Chinese text recognition with LSTM-RNN. Proceedings of the 13th International Conference on Document Analysis and Recognition (ICDAR), Tunis, Tunisia.10.1109/ICDAR.2015.7333746 ↗
40. Wang, Z., and Liu, J.C. (2019). Translating Mathematical Formula Images to LaTeX Sequences Using Deep Neural Networks with Sequence-level Training. arXiv.
41. Karpathy, A., and Fei-Fei, L. (2015, January 7–12). Deep visual-semantic alignments for generating image descriptions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298932 ↗
42. Mikolov, T., and Zweig, G. (2012, January 2–5). Context dependent recurrent neural network language model. Proceedings of the IEEE Spoken Language Technology Workshop (SLT), Miami, FL, USA.10.1109/SLT.2012.6424228 ↗
43. Zaheer, M., Ahmed, A., and Smola, A.J. (2017, January 6–11). Latent LSTM allocation joint clustering and non-linear dynamic modeling of sequential data. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.
44. Chen, Z., Teng, S., Zhang, W., Tang, H., Zhang, Z., He, J., Fang, X., and Fei, L. (2018, January 16–18). LSTM Sentiment Polarity Analysis Based on LDA Clustering. Proceedings of the CCF Conference on Computer Supported Cooperative Work and Social Computing, Kunming, China.10.1007/978-981-13-3044-5_25 ↗
45. Tian, F., Gao, B., He, D., and Liu, T.Y. (2016). Sentence level recurrent topic model: letting topics speak for themselves. arXiv.
46. Serban, I.V., Sordoni, A., Lowe, R., Charlin, L., Pineau, J., Courville, A., and Bengio, Y. (2017, January 4–9). A hierarchical latent variable encoder-decoder model for generating dialogues. Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, San Francisco, CA, USA.10.1609/aaai.v31i1.10983 ↗
47. Chung, J., Kastner, K., Dinh, L., Goel, K., Courville, A.C., and Bengio, Y. (2015). A recurrent latent variable model for sequential data. Advances in Neural Information Processing Systems, Mit Press.
48. Eberhart, R., and Kennedy, J. (December, January 27). Particle swarm optimization. Proceedings of the IEEE International Conference on Neural Networks, Perth, Australia.
49. Ermakova, T., Baumann, A., Fabian, B., and Krasnova, H. (2014, January 7–9). Privacy Policies and Users’ Trust: Does Readability Matter?. Proceedings of the Twentieth Americas Conference on Information Systems (AMCIS 2014), Savannah, GA, USA.
50. Should I trust him? The effects of reviewer profile characteristics on eWOM credibility10.1016/j.chb.2014.01.027 ↗
51. The effects of motivation, deterrents, trust, and risk on tourism crowdfunding behavior10.1080/10941665.2019.1687533 ↗
52. Fraud in medical crowdfunding: A typology of publicized cases and policy recommendations10.1002/poi3.188 ↗
53. Hu, W., and Yang, R. (2019, January 5–6). Predicting the success of Kickstarter projects in the US at launch time. Proceedings of the SAI Intelligent Systems Conference, London, UK.10.1007/978-3-030-29516-5_39 ↗
54. Desai, N., Gupta, R., and Truong, K. (2015). Plead or Pitch? The Role of Language in Kickstarter Project Success, Stanford University.
55. Sawhney, K., Tran, C., and Tuason, R. (2016). Using Language to Predict Kickstarter Success, Stanford University.
56. Westerlund, M., Singh, I., Rajahonka, M., and Leminen, S. (2019). Can short-text project summaries predict funding success on crowdfunding platforms?. ISPIM Conference Proceedings, The International Society for Professional Innovation Management (ISPIM).
57. Do Carmo, R.A., Kang, S.M., and Silva, R. (2017, January 26–28). Visualization of topic-sentiment dynamics in crowdfunding projects. Proceedings of the International Symposium on Intelligent Data Analysis, London, UK.10.1007/978-3-319-68765-0_4 ↗
58. Detecting fraudulent behavior on crowdfunding platforms: The role of linguistic and content-based cues in static and dynamic contexts10.1080/07421222.2016.1205930 ↗
59. Cumming, D.J., Hornuf, L., Karami, M., and Schweizer, D. (2016). Disentangling crowdfunding from fraudfunding. SSRN.10.2139/ssrn.2828919 ↗
60. Tran, T., Lee, K., Vo, N., and Choi, H. (August, January 31). Identifying on-time reward delivery projects with estimating delivery duration on kickstarter. Proceedings of the 2017 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining, Sydney, Australia.10.1145/3110025.3110069 ↗
61. Measuring guest satisfaction and competitive position in the hospitality and tourism industry an application of stance-shift analysis to travel blog narratives10.1177/0047287508328795 ↗
62. A comparative analysis of major online review platforms: Implications for social media analytics in hospitality and tourism10.1016/j.tourman.2016.10.001 ↗
63. Sentiment analysis for movies reviews dataset using deep learning models
64. Shukla, A., Wang, W., Gao, G.G., and Agarwal, R. (2019). Catch me if you can: Detecting fraudulent online reviews of doctors using deep learning. SSRN.10.2139/ssrn.3320258 ↗
65. Cloud decision support model for selecting hotels on TripAdvisor.com with probabilistic linguistic information10.1016/j.ijhm.2017.10.001 ↗
66. More than words: Do emotional content and linguistic style matching matter on restaurant review helpfulness?10.1016/j.ijhm.2018.08.007 ↗
67. Elmurngi, E., and Gherbi, A. (2017, January 12–16). Detecting fake reviews through sentiment analysis using machine learning techniques. Proceedings of the Sixth International Conference on Data Analytics IARIA/Data Analytics, Barcelona, Spain.
68. Chen, L., Li, W., Chen, H., and Geng, S. (2019). Detection of fake reviews: Analysis of sellers’ manipulation behavior. Sustainability, 11.10.3390/su11174802 ↗