journal article·2020-12-14Open access

Identifying Human Daily Activity Types with Time-Aware Interactions

Renyao Chen, Hong Yao, Runjia Li, Xiaojun Kang, Shengwen Li, Lijun Dong, Junfang Gong

Applied Sciences· Volume 10· Issue 24

Abstract

Human activities embedded in crowdsourced data, such as social media trajectory, represent individual daily styles and patterns, which are valuable in many applications. However, the accurate identification of human activity types (HATs) from social media is challenging, possibly because interactions between posts and users at different time are overlooked. To fill this gap, we propose a novel model that introduces the interactions hidden in social media and synthesizes Graph Convolutional Network (GCN) for identifying HAT. The model first characterizes interactions among words, posts, dates, and users, and then derives a Time Gated Human Activity Graph Convolutional Network (TG-HAGCN) to predict the HATs of social media trajectory. To examine the proposed model performance, we built a new dataset including interactions between post content, post time, and users from the open Yelp dataset. Experimental results show that exploiting interactions hidden in social media to recognize HATs achieves state-of-the-art performance with high accuracy. The study indicates that interactions among social media promotes ability of machine learning on social media data mining and intelligent applications, and offers a reference solution for how to fuse multi-type heterogeneous data in social media.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human Mobility and Location-Based Analysis · Advanced Graph Neural Networks · Complex Network Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Geography and Information Engineering, China University of Geosciences, Wuhan 430074, China

School of Computer Science, China University of Geosciences, Wuhan 430074, China

National Engineering Research Center for Geographic Information System, China University of Geosciences, Wuhan 430074, China

Key Laboratory of Urban Land Resources Monitoring and Simulation, Ministry of Natural Resources, Shenzhen 518034, China

Funding

National Natural Science Foundation of China

References (29)

Show source-provided references
1. Coupling mobile phone and social media data: A new approach to understanding urban functions and diurnal patterns10.1080/13658816.2017.1356464 ↗
2. Smart cities of the future10.1140/epjst/e2012-01703-3 ↗
3. Context-aware recommendations through context and activity recognition in a mobile environment10.1007/s11042-013-1582-x ↗
4. Heart rate monitoring, activity recognition, and recommendation for e-coaching10.1007/s11042-018-5640-2 ↗
5. Urban activity pattern classification using topic models from online geo-location data10.1016/j.trc.2014.04.003 ↗
6. Gong, J., Li, R., Yao, H., Kang, X., and Li, S. (2019). Recognizing human daily activity using social media sensors and deep learning. Int. J. Environ. Res. Public Health, 16.10.3390/ijerph16203955 ↗
7. Saha, J., Chowdhury, C., Chowdhury, I.R., Biswas, S., and Aslam, N. (2018). An ensemble of condition based classifiers for device independent detailed human activity recognition using smartphones. Information, 9.10.3390/info9040094 ↗
8. Salomón, S., and Tîrnăucă, C. (2018). Human Activity Recognition through Weighted Finite Automata. Proceedings, 2.10.3390/proceedings2191263 ↗
9. Deep learning for sensor-based activity recognition: A survey10.1016/j.patrec.2018.02.010 ↗
10. Online human activity recognition employing hierarchical hidden Markov models10.1007/s12652-019-01380-5 ↗
11. Human Activity Recognition using Inertial, Physiological and Environmental Sensors: A Comprehensive Survey10.1109/ACCESS.2020.3037715 ↗
12. Sequential pattern mining of geo-tagged photos with an arbitrary regions-of-interest detection method10.1016/j.eswa.2013.10.057 ↗
13. G-RoI: Automatic Region-of-Interest Detection Driven by Geotagged Social Media Data
14. Liu, H., Luo, B., and Lee, D. (2012, January 12–15). Location type classification using tweet content. Proceedings of the 11th International Conference on Machine Learning and Applications, Boca Raton, FL, USA.10.1109/ICMLA.2012.47 ↗
15. Dearman, D., Sohn, T., and Truong, K.N. (2011, January 7–13). Opportunities Exist: Continuous discovery of places to perform activities. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, BC, Canada.10.1145/1978942.1979297 ↗
16. Benetka, J.R., Balog, K., and Nørvag, K. (, January February). Anticipating information needs based on check-in activity. Proceedings of the 10th ACM International Conference on Web Search and Data Mining, Cambridge UK.
17. Modeling user activity preference by leveraging user spatial temporal characteristics in LBSNs10.1109/TSMC.2014.2327053 ↗
18. Krumm, J., Rouhana, D., and Chang, M.W. (2015, January 23–27). Placer++: Semantic place labels beyond the visit. Proceedings of the IEEE International Conference on Pervasive Computing and Communications, St. Louis, MO, USA.
19. Lian, D., and Xie, X. (2011, January 1). Collaborative activity recognition via check-in history. Proceedings of the 3rd ACM SIGSPATIAL International Workshop on Location-Based Social Networks, Chicago, IL, USA.10.1145/2063212.2063230 ↗
20. Beber, M.A., Ferrero, C.A., Fileto, R., and Bogorny, V. (2016, January 27–30). Towards activity recognition in moving object trajectories from twitter data. Proceedings of the Brazilian Symposium on GeoInformatics, São Paulo, Brazil.
21. Weerkamp, W., and Rijke, D. (2012, January 4). Activity Prediction: A Twitter-Based Exploration. Proceedings of the SIGIR 2012 Workshop on Time-Aware Information Access, Portland, OR, USA.
22. Song, Y., Lu, Z., Leung, C.W.K., and Yang, Q. (2013, January 11–14). Collaborative boosting for activity classification in microblogs. Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Chicago, IL, USA.10.1145/2487575.2487661 ↗
23. Recognizing composite daily activities from crowd-labelled social media data10.1016/j.pmcj.2015.10.007 ↗
24. Mazumder, S., Patel, D., and Mehta, S. (2014, January 2–4). ActMiner: Discovering location-specific activities from community-authored reviews. Proceedings of the 16th International Conference, DaWaK 2014, Munich, Germany.10.1007/978-3-319-10160-6_30 ↗
25. Wu, Z., Pan, S., Chen, F., Long, G., Zhang, C., and Yu, P.S. (2020). A Comprehensive Survey on Graph Neural Networks. IEEE Trans. Neural Netw. Learn. Syst., 1–21.10.1109/TNNLS.2020.2978386 ↗
26. On the First Law of Geography10.1111/j.1467-8306.2004.09402009.x ↗
27. SentiMI: Introducing point-wise mutual information with SentiWordNet to improve sentiment polarity detection10.1016/j.asoc.2015.11.016 ↗
28. Shaw, S.-L., and Sui, D. (2018). Human Dynamics in Smart Cities, Springer.
29. Bello, I., Zoph, B., Vasudevan, V., and Le, Q.V. (2017, January 6–11). Neural optimizer search with Reinforcement learning. Proceedings of the 34th International Conference on Machine Learning, Sydney, Australia.