journal article·2019-11-16Open access

The Design of an Automated System for the Analysis of the Activity and Emotional Patterns of Dogs with Wearable Sensors Using Machine Learning

Satyabrata Aich, Sabyasachi Chakraborty, Jong-Seong Sim, Dong-Jin Jang, Hee-Cheol Kim

Applied Sciences· Volume 9· Issue 22

Abstract

The safety and welfare of companion animals such as dogs has become a large challenge in the last few years. To assess the well-being of a dog, it is very important for human beings to understand the activity pattern of the dog, and its emotional behavior. A wearable, sensor-based system is suitable for such ends, as it will be able to monitor the dogs in real-time. However, the question remains unanswered as to what kind of data should be used to detect the activity patterns and emotional patterns, as does another: what should be the location of the sensors for the collection of data and how should we automate the system? Yet these questions remain unanswered, because to date, there is no such system that can address the above-mentioned concerns. The main purpose of this study was (1) to develop a system that can detect the activities and emotions based on the accelerometer and gyroscope signals and (2) to automate the system with robust machine learning techniques for implementing it for real-time situations. Therefore, we propose a system which is based on the data collected from 10 dogs, including nine breeds of various sizes and ages, and both genders. We used machine learning classification techniques for automating the detection and evaluation process. The ground truth fetched for the evaluation process was carried out by taking video recording data in frame per second and the wearable sensors data were collected in parallel with the video recordings. Evaluation of the system was performed using an ANN (artificial neural network), random forest, SVM (support vector machine), KNN (k nearest neighbors), and a naïve Bayes classifier. The robustness of our system was evaluated by taking independent training and validation sets. We achieved an accuracy of 96.58% while detecting the activity and 92.87% while detecting emotional behavior, respectively. This system will help the owners of dogs to track their behavior and emotions in real-life situations for various breeds in different scenarios.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human-Animal Interaction Studies · Rabies epidemiology and control · Animal Behavior and Welfare Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Digital Anti-Aging Healthcare, Inje University, Gimhae 50834, Korea

Department of Computer Engineering, Inje University, Gimhae 50834, Korea

u-HARC, Inje University, Gimhae 50834, Korea

Funding

Ministry of Trade, Industry and Energy

References (49)

Show source-provided references
1. A new technique for monitoring the detailed behavior of terrestrial animals: A case study with the domestic cat10.1016/j.applanim.2005.01.010 ↗
2. Bio-logging science: Logging and relaying physical and biological data using animal-attached tags10.1016/j.dsr2.2007.01.001 ↗
3. The need for speed: Testing acceleration for estimating animal travel rates in terrestrial dead-reckoning systems10.1016/j.zool.2011.09.003 ↗
4. Sensing solutions for collecting spatio-temporal data for wildlife monitoring applications: A review10.3390/s130506054 ↗
5. Multi-sensor fusion in body sensor networks: State-of-the-art and research challenges10.1016/j.inffus.2016.09.005 ↗
6. A framework for collaborative computing and multi-sensor data fusion in body sensor networks10.1016/j.inffus.2014.03.005 ↗
7. A Multichannel Convolutional Neural Network Architecture for the Detection of the State of Mind Using Physiological Signals from Wearable Devices10.1155/2019/5397814 ↗
8. Enabling effective programming and flexible management of efficient body sensor network applications10.1109/TSMCC.2012.2215852 ↗
9. BodyCloud: A SaaS approach for community body sensor networks10.1016/j.future.2013.12.015 ↗
10. Genesis and evolution of bio-logging devices
11. A new technique for monitoring the behavior of free-ranging Adelie penguins10.1242/jeb.204.4.685 ↗
12. Prying into the intimate details of animal lives: Use of a daily diary on animals10.3354/esr00064 ↗
13. An embedded system for real-time navigation and remote command of a trained canine10.1007/s00779-010-0298-4 ↗
14. Cooper, C. (2015). How to Listen to Your Dog: The Complete Guide to Communicating with Man’s Best Friend, Atlantic Publishing Company.
15. Seeing left-or right-asymmetric tail wagging produces different emotional responses in dogs10.1016/j.cub.2013.09.027 ↗
16. How heart rate variability affects emotion regulation brain networks10.1016/j.cobeha.2017.12.017 ↗
17. Human emotion classification based on multiple physiological signals by wearable system10.3233/THC-174747 ↗
18. De Seabra, J., Rybarczyk, Y., Batista, A., Rybarczyk, P., Lebret, M.C., and Vernay, D. (2019, September 18). Development of a Wearable Monitoring System for Service Dogs. Available online: https://docentes.fct.unl.pt/agb/files/service_dogs.pdf.
19. Ladha, C., Hammerla, N., Hughes, E., Olivier, P., and Ploetz, T. (2013, January 8–12). Dog’s life: Wearable activity recognition for dogs. Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Zurich, Switzerland.10.1145/2493432.2493519 ↗
20. External validation of a collar-mounted triaxial accelerometer for second-by-second monitoring of eight behavioral states in dogs10.1371/journal.pone.0188481 ↗
21. Design and Analysis of Smart Sensing System for Animal Emotions Recognition
22. Wernimont, S., Thompson, R., Mickelsen, S., Smith, S., Alvarenga, I., and Gross, K. (2018). Use of accelerometer activity monitors to detect changes in pruritic behaviors: Interim clinical data on 6 dogs. Sensors., 18.10.3390/s18010249 ↗
23. Gerencsér, L., Vásárhelyi, G., Nagy, M., Vicsek, T., and Miklósi, A. (2013). Identification of behavior in freely moving dogs (Canis familiaris) using inertial sensors. PLoS ONE, 8.10.1371/journal.pone.0077814 ↗
24. Cattle behavior classification from collar, halter, and ear tag sensors
25. The effect of different time epoch settings on the classification of sheep behavior using tri-axial accelerometry10.1016/j.compag.2018.09.002 ↗
26. Using accelerometers to remotely and automatically characterize behavior in small animals
27. A novel biomechanical approach for animal behavior recognition using accelerometers10.1111/2041-210X.13172 ↗
28. Wearable heart rate sensor systems for wireless canine health monitoring10.1109/JSEN.2015.2485210 ↗
29. Venkatraman, S., Long, J.D., Pister, K.S., and Carmena, J.M. (2007, January 23–26). Wireless inertial sensors for monitoring animal behavior. Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France.10.1109/IEMBS.2007.4352303 ↗
30. Evaluation of an accelerometer for at-home monitoring of spontaneous activity in dogs10.2460/ajvr.68.5.468 ↗
31. Grünewälder, S., Broekhuis, F., Macdonald, D.W., Wilson, A.M., McNutt, J.W., Shawe-Taylor, J., and Hailes, S. (2012). Movement activity based classification of animal behavior with an application to data from cheetah (Acinonyx jubatus). PLoS ONE, 7.10.1371/journal.pone.0049120 ↗
32. McClune, D.W., Marks, N.J., Wilson, R.P., Houghton, J.D., Montgomery, I.W., McGowan, N.E., Gormley, E., and Scantlebury, M. (2014). Tri-axial accelerometers quantify behavior in the Eurasian badger (Meles meles): Towards an automated interpretation of field data. Anim. Biotelemetry, 2.10.1186/2050-3385-2-5 ↗
33. Nazmi, N., Abdul Rahman, M., Yamamoto, S.I., Ahmad, S., Zamzuri, H., and Mazlan, S. (2016). A review of classification techniques of EMG signals during isotonic and isometric contractions. Sensors, 16.10.3390/s16081304 ↗
34. Rosati, S., Balestra, G., and Knaflitz, M. (2018). Comparison of Different Sets of Features for Human Activity Recognition by Wearable Sensors. Sensors., 18.10.3390/s18124189 ↗
35. Energy-efficient integration of continuous context sensing and prediction into smartwatches10.3390/s150922616 ↗
36. Mining personal data using smartphones and wearable devices: A survey10.3390/s150204430 ↗
37. Data mining for wearable sensors in health monitoring systems: A review of recent trends and challenges10.3390/s131217472 ↗
38. Castro, D., Coral, W., Rodriguez, C., Cabra, J., and Colorado, J. (2017). Wearable-based human activity recognition using an iot approach. J. Sens. Actuator Netw., 6.10.3390/jsan6040028 ↗
39. Fault Diagnosis Management Model using Machine Learning
40. Aich, S., Pradhan, P., Park, J., Sethi, N., Vathsa, V., and Kim, H.C. (2018). A validation study of freezing of gait (FoG) detection and machine-learning-based FoG prediction using estimated gait characteristics with a wearable accelerometer. Sensors, 18.10.3390/s18103287 ↗
41. Learning from imbalanced data: Open challenges and future directions10.1007/s13748-016-0094-0 ↗
42. Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset10.1016/j.neucom.2015.11.095 ↗
43. A new classification strategy for human activity recognition using cost sensitive support vector machines for imbalanced data”10.1108/K-07-2014-0138 ↗
44. Fergani, B., and Clavier, L. (2013, January 12–15). Importance-weighted the imbalanced data for C-SVM classifier to human activity recognition. Proceedings of the 2013 8th International Workshop on Systems, Signal Processing and their Applications (WoSSPA), Algeria, Zalalada.
45. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
46. Zhao, B., Wang, Z., Yu, Z., and Guo, B. (2018, January 8–12). EmotionSense: Emotion Recognition Based on Wearable Wristband. Proceedings of the 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), Guangzhou, China.10.1109/SmartWorld.2018.00091 ↗
47. Dobbins, C., and Fairclough, S. (2018, January 19–23). Detecting negative emotions during real-life driving via dynamically labelled physiological data. Proceedings of the 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Athens, Greece.10.1109/PERCOMW.2018.8480369 ↗
48. Machine learning classification of design team members’ body language patterns for real time emotional state detection10.1016/j.destud.2015.04.003 ↗
49. Dogs’ body language relevant to learning achievement10.3390/ani4010045 ↗