The Importance of Context Awareness in Acoustics-Based Automated Beehive Monitoring
Source abstract
Abstract
The vital role of honeybees in pollination and their high rate of mortality in the last decade have raised concern among beekeepers and researchers alike. As such, robust and remote sensing of beehives has emerged as a potential tool to help monitor the health of honeybees. Over the last decade, several monitoring systems have been proposed, including those based on in-hive acoustics. Despite its popularity, existing audio-based systems do not take context into account (e.g., environmental noise factors), and thus the performance may be severely hampered when deployed. In this paper, we investigate the effect that three different environmental noise factors (i.e., nearby train rail squealing, beekeeper speech, and rain noise) can have on three acoustic features (i.e., spectrogram, mel frequency cepstral coefficients, and discrete wavelet coefficients) used in existing automated beehive monitoring systems. To this end, audio data were collected continuously over a period of three months (August, September, and October) in 2021 from 11 urban beehives located in downtown Montréal, Québec, Canada. A system based on these features and a convolutional neural network was developed to predict beehive strength, an indicator of the size of the colony. Results show the negative impact that environmental factors can have across all tested features, resulting in an increase of up to 355% in mean absolute prediction error when heavy rain was present.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Plant and animal studies · Insect and Pesticide Research · Insect and Arachnid Ecology and Behavior
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
INRS-EMT, University of Quebec, 800 Rue de la Gauchetiere Ouest, Montreal, QC H5A 1K6, Canada
Nectar Technologies Inc., 302-6250 Rue Hutchison, Montreal, QC H2V 4C5, Canada
Biology Department, Faculty of Science and Engineering, Laval University, 2325 Rue de l’Universite, Quebec, QC G1V 0A6, Canada
Funding
NSERC Canada · Nectar Technologies Inc. · Deschambault Animal Science Research Centre
References (64)
Show source-provided references
1. FAO, Apimondia, CAAS, and IZSLT (2021). Good Beekeeping Practices for Sustainable Apiculture.
2. Toward an intelligent and efficient beehive: A survey of precision beekeeping systems and services10.1016/j.compag.2021.106604 ↗
3. Ruvinga, S., Hunter, G.J., Duran, O., and Nebel, J.C. (2021, January 21–24). Use of LSTM Networks to Identify “Queenlessness” in Honeybee Hives from Audio Signals. Proceedings of the 2021 17th International Conference on Intelligent Environments (IE), Dubai, United Arab Emirates.10.1109/IE51775.2021.9486575 ↗
4. Dubois, S., Choveton-Caillat, J., Kane, W., Gilbert, T., Nfaoui, M., El Boudali, M., Rezzouki, M., and Ferré, G. (2021, January 22–28). Bee Detection For Fruit Cultivation. Proceedings of the 2021 IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Republic of Korea.10.1109/ISCAS51556.2021.9401393 ↗
5. Peng, R., Ardekani, I., and Sharifzadeh, H. (2020, January 7–10). An Acoustic Signal Processing System for Identification of Queen-less Beehives. Proceedings of the 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Auckland, New Zealand.
6. Precision apiculture: Development of a wireless sensor network for honeybee hives10.1016/j.compag.2018.11.001 ↗
7. Cecchi, S., Spinsante, S., Terenzi, A., and Orcioni, S. (2020). A Smart Sensor-Based Measurement System for Advanced Bee Hive Monitoring. Sensors, 20.10.3390/s20092726 ↗
8. A method for mining combined data from in-hive sensors, weather and apiary inspections to forecast the health status of honey bee colonies10.1016/j.compag.2019.105161 ↗
9. Within-day variation in continuous hive weight data as a measure of honey bee colony activity10.1051/apido:2008055 ↗
10. Temperature changes above the upper hive body reveal the annual development periods of honey bee colonies10.1016/j.compag.2012.10.003 ↗
11. b+ WSN: Smart beehive with preliminary decision tree analysis for agriculture and honey bee health monitoring10.1016/j.compag.2016.04.008 ↗
12. The quantitative and qualitative effect of weather upon colony weight changes10.1093/jee/18.3.447a ↗
13. The effects of temperature changes to bee losts
14. Seeley, T., and Heinrich, B. (1981). Regulation of Temperature in the Nests of Social Insects, Wiley.
15. Seeley, T.D. (2014). Honeybee ecology. Honeybee Ecology, Princeton University Press.
16. Remote detection of the swarming of honey bee colonies by single-point temperature monitoring10.1016/j.biosystemseng.2016.05.012 ↗
17. A review of impacts of temperature and relative humidity on various activities of honey bees10.1007/s00040-017-0573-8 ↗
18. Do honeybees, Apis mellifera scutellata, regulate humidity in their nest?10.1007/s00114-006-0117-y ↗
19. Sound and vibrational signals in the dance language of the honeybee, Apis mellifera10.1007/BF00290824 ↗
20. Intracolony vibroacoustic communication in social insects10.1007/s00040-013-0311-9 ↗
21. Bromenshenk, J.J., Henderson, C.B., Seccomb, R.A., Rice, S.D., and Etter, R.T. (2009). Honey bee acoustic recording and analysis system for monitoring hive health. (7,549,907), US Patent.
22. Zlatkova, A., Kokolanski, Z., and Tashkovski, D. (2020, January 16–18). Honeybees swarming detection approach by sound signal processing. Proceedings of the 2020 XXIX International Scientific Conference Electronics (ET), Sozopol, Bulgaria.10.1109/ET50336.2020.9238260 ↗
23. Žgank, A. (2018, January 16–19). Acoustic monitoring and classification of bee swarm activity using MFCC feature extraction and HMM acoustic modeling. Proceedings of the 2018 ELEKTRO, Moscow, Russia.10.1109/ELEKTRO.2018.8398253 ↗
24. Abdollahi, M., Giovenazzo, P., and Falk, T.H. (2022). Automated Beehive Acoustics Monitoring: A Comprehensive Review of the Literature and Recommendations for Future Work. Appl. Sci., 12.10.3390/app12083920 ↗
25. Heise, D., Miller-Struttmann, N., Galen, C., and Schul, J. (2017, January 13–15). Acoustic detection of bees in the field using CASA with focal templates. Proceedings of the 2017 IEEE Sensors Applications Symposium (SAS), Glassboro, NJ, USA.10.1109/SAS.2017.7894089 ↗
26. Acoustic Scene Classification and Visualization of Beehive Sounds Using Machine Learning Algorithms and Grad-CAM10.1155/2021/5594498 ↗
27. Nolasco, I., and Benetos, E. (2018). To bee or not to bee: Investigating machine learning approaches for beehive sound recognition. arXiv.
28. Zhang, T., Zmyslony, S., Nozdrenkov, S., Smith, M., and Hopkins, B. (2021). Semi-Supervised Audio Representation Learning for Modeling Beehive Strengths. arXiv.
29. Terenzi, A., Cecchi, S., Orcioni, S., and Piazza, F. (2018, January 23–25). Features extraction applied to the analysis of the sounds emitted by honey bees in a beehive. Proceedings of the 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA), Dubrovnik, Croatia.10.1109/ISPA.2019.8868934 ↗
30. Nolasco, I., Terenzi, A., Cecchi, S., Orcioni, S., Bear, H.L., and Benetos, E. (2019, January 12–17). Audio-based identification of beehive states. Proceedings of the ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.10.1109/ICASSP.2019.8682981 ↗
31. Comparison of Feature Extraction Methods for Sound-based Classification of Honey Bee Activity10.1109/TASLP.2021.3133194 ↗
32. Bee swarm detection based on comparison of estimated distributions samples of sound10.1109/TIM.2018.2878594 ↗
33. Anand, N., Raj, V.B., Ullas, M., and Srivastava, A. (2018, January 3–5). Swarm Detection and Beehive Monitoring System using Auditory and Microclimatic Analysis. Proceedings of the 2018 3rd International Conference on Circuits, Control, Communication and Computing (I4C), Bangalore, India.10.1109/CIMCA.2018.8739710 ↗
34. Zlatkova, A., Gerazov, B., Tashkovski, D., and Kokolanski, Z. (2020, January 24–25). Analysis of parameters in algorithms for signal processing for swarming of honeybees. Proceedings of the 2020 28th Telecommunications Forum (TELFOR), Belgrade, Serbia.10.1109/TELFOR51502.2020.9306562 ↗
35. Remote Beehive Monitoring Using Acoustic Signals
36. Soundscape Indices: New Features for Classifying Beehive Audio Samples10.13102/sociobiology.v67i4.5860 ↗
37. Based investigate of beehive sound to detect air pollutants by machine learning10.1016/j.ecoinf.2021.101246 ↗
38. Continuous monitoring of beehives’ sound for environmental pollution control10.1016/j.ecoleng.2016.01.082 ↗
39. Processing of multi-modal environmental signals recorded from a “smart” beehive
40. Cecchi, S., Terenzi, A., Orcioni, S., Riolo, P., Ruschioni, S., and Isidoro, N. (2018, January 23–26). A preliminary study of sounds emitted by honey bees in a beehive. Proceedings of the Audio Engineering Society Convention 144, Milan, Italy.
41. Zacepins, A., Kviesis, A., Ahrendt, P., Richter, U., Tekin, S., and Durgun, M. (June, January 29). Beekeeping in the future—Smart apiary management. Proceedings of the 2016 17th International Carpathian Control Conference (ICCC), High Tatras, Slovakia.10.1109/CarpathianCC.2016.7501207 ↗
42. Development of a Low-Cost Wireless Bee-Hive Temperature and Sound Monitoring System
43. Analysis of a multiclass classification problem by lasso logistic regression and singular value decomposition to identify sound patterns in queenless bee colonies10.1016/j.compag.2019.02.024 ↗
44. Frequency Analysis of Honey Bee Buzz for Automatic Recognition of Health Status: A Preliminary Study10.13053/rcs-142-1-9 ↗
45. Worker piping in honey bee swarms and its role in preparing for liftoff10.1007/s00359-001-0243-0 ↗
46. Queen confinement, queen piping and swarming in Apis mellifera colonies10.1016/0003-3472(69)90012-8 ↗
47. Managed honey bee colony losses in Canada, China, Europe, Israel and Turkey, for the winters of 2008–9 and 2009–1010.3896/IBRA.1.51.1.12 ↗
48. Jacques, A., Laurent, M., Consortium, E., Ribière-Chabert, M., Saussac, M., Bougeard, S., Budge, G.E., Hendrikx, P., and Chauzat, M.P. (2017). A pan-European epidemiological study reveals honey bee colony survival depends on beekeeper education and disease control. PLoS ONE, 12.10.1371/journal.pone.0172591 ↗
49. A national survey of managed honey bee 2015–2016 annual colony losses in the USA10.1080/00218839.2017.1344496 ↗
50. Multi-country loss rates of honey bee colonies during winter 2016/2017 from the COLOSS survey10.1080/00218839.2018.1460911 ↗
51. Loss rates of honey bee colonies during winter 2017/18 in 36 countries participating in the COLOSS survey, including effects of forage sources10.1080/00218839.2019.1615661 ↗
52. Honey bee colony winter loss rates for 35 countries participating in the COLOSS survey for winter 2018–2019, and the effects of a new queen on the risk of colony winter loss10.1080/00218839.2020.1797272 ↗
53. Porrini, C., Mutinelli, F., Bortolotti, L., Granato, A., Laurenson, L., Roberts, K., Gallina, A., Silvester, N., Medrzycki, P., and Renzi, T. (2016). The status of honey bee health in Italy: Results from the nationwide bee monitoring network. PLoS ONE, 11.10.1371/journal.pone.0155411 ↗
54. Looking for the causes of and solutions to the issue of honey bee colony losses10.2478/acve-2019-0001 ↗
55. Comparison of parametric representations for monosyllabic word recognition in continuously spoken sentences10.1109/TASSP.1980.1163420 ↗
56. Acoustic scene classification: Classifying environments from the sounds they produce10.1109/MSP.2014.2326181 ↗
57. Gaballah, A., Tiwari, A., Narayanan, S., and Falk, T.H. (2021, January 6–12). Context-aware speech stress detection in hospital workers using Bi-LSTM classifiers. Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414666 ↗
58. Stange, E. (2020). Optimizing urban beekeeping. Achieving Sustainable urban Agriculture, Burleigh Dodds Science Publishing.10.19103/AS.2019.0063.18 ↗
59. (2022, November 15). Nectar. Available online: https://www.nectar.buzz/.
60. Rapid measurement of the adult worker population size in honey bees10.1016/j.ecolind.2020.107313 ↗
61. Multiresolution approximations and wavelet orthonormal bases of L2(R)
62. Daubechies, I. (1992). Ten Lectures on Wavelets, SIAM.10.1137/1.9781611970104 ↗
63. Modulation spectral features for robust far-field speaker identification10.1109/TASL.2009.2023679 ↗
64. Avila, A.R., Monteiro, J., O’Shaughneussy, D., and Falk, T.H. (2017, January 18–20). Speech emotion recognition on mobile devices based on modulation spectral feature pooling and deep neural networks. Proceedings of the 2017 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT), Bilbao, Spain.10.1109/ISSPIT.2017.8388669 ↗