journal article·2022-04-13Open access

Automated Beehive Acoustics Monitoring: A Comprehensive Review of the Literature and Recommendations for Future Work

Mahsa Abdollahi, Pierre Giovenazzo, Tiago H. Falk

Applied Sciences· Volume 12· Issue 8

Abstract

Bees play an important role in agriculture and ecology, and their pollination efficiency is essential to the economic profitability of farms. The drastic decrease in bee populations witnessed over the last decade has attracted great attention to automated remote beehive monitoring research, with beehive acoustics analysis emerging as a prominent field. In this paper, we review the existing literature on bee acoustics analysis and report on the articles published between January 2012 and December 2021. Five categories are explored in further detail, including the origin of the articles, their study goal, experimental setup, audio analysis methodology, and reproducibility. Highlights and limitations in each of these categories are presented and discussed. We conclude with a set of recommendations for future studies, with suggestions ranging from bee species characterization, to recording and testing setup descriptions, to making data and codes available to help advance this new multidisciplinary field.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Plant and animal studies · Insect and Pesticide Research · Insect and Arachnid Ecology and Behavior

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

INRS-EMT, University of Quebec, 800 Rue de la Gauchetiere Ouest, Montreal, QC H5A 1K6, Canada

Faculty of Science and Engineering, Biology Department, Laval University, 2325 rue de l’Universite, Quebec, QC G1V 0A6, Canada

Funding

Natural Sciences and Engineering Research Council

References (100+)

Show source-provided references
1. FAO, Apimondia, CAAS, and IZSLT (2021). Good Beekeeping Practices for Sustainable Apiculture, FAO.
2. Liao, Y., McGuirk, A., Biggs, B., Chaudhuri, A., Langlois, A., and Deters, V. (2020). Noninvasive Beehive Monitoring through Acoustic Data Using SASA® Event Stream Processing and SAS® Viya®, SAS Institute Inc.
3. Managed honey bee colony losses in Canada, China, Europe, Israel and Turkey, for the winters of 2008–2009 and 2009–201010.3896/IBRA.1.51.1.12 ↗
4. Jacques, A., Laurent, M., Consortium, E., Ribière-Chabert, M., Saussac, M., Bougeard, S., Budge, G.E., Hendrikx, P., and Chauzat, M.P. (2017). A pan-European epidemiological study reveals honey bee colony survival depends on beekeeper education and disease control. PLoS ONE, 12.10.1371/journal.pone.0172591 ↗
5. A national survey of managed honey bee 2015–2016 annual colony losses in the USA10.1080/00218839.2017.1344496 ↗
6. Multi-country loss rates of honey bee colonies during winter 2016/2017 from the COLOSS survey10.1080/00218839.2018.1460911 ↗
7. Loss rates of honey bee colonies during winter 2017/18 in 36 countries participating in the COLOSS survey, including effects of forage sources10.1080/00218839.2019.1615661 ↗
8. Honey bee colony winter loss rates for 35 countries participating in the COLOSS survey for winter 2018–2019, and the effects of a new queen on the risk of colony winter loss10.1080/00218839.2020.1797272 ↗
9. Oldroyd, B.P. (2007). What’s killing American honey bees?. PLoS Biol., 5.10.1371/journal.pbio.0050168 ↗
10. Porrini, C., Mutinelli, F., Bortolotti, L., Granato, A., Laurenson, L., Roberts, K., Gallina, A., Silvester, N., Medrzycki, P., and Renzi, T. (2016). The status of honey bee health in Italy: Results from the nationwide bee monitoring network. PLoS ONE, 11.10.1371/journal.pone.0155411 ↗
11. Looking for the causes of and solutions to the issue of honey bee colony losses10.2478/acve-2019-0001 ↗
12. Cecchi, S., Spinsante, S., Terenzi, A., and Orcioni, S. (2020). A Smart Sensor-Based Measurement System for Advanced Bee Hive Monitoring. Sensors, 20.10.3390/s20092726 ↗
13. Application of continuous monitoring of honeybee colonies10.1007/s13592-014-0298-x ↗
14. A method for mining combined data from in-hive sensors, weather and apiary inspections to forecast the health status of honey bee colonies10.1016/j.compag.2019.105161 ↗
15. Temperature changes above the upper hive body reveal the annual development periods of honey bee colonies10.1016/j.compag.2012.10.003 ↗
16. b+ WSN: Smart beehive with preliminary decision tree analysis for agriculture and honey bee health monitoring10.1016/j.compag.2016.04.008 ↗
17. Bromenshenk, J.J., Henderson, C.B., Seccomb, R.A., Rice, S.D., and Etter, R.T. (2009). Honey Bee Acoustic Recording and Analysis System for Monitoring Hive Health. (7,549,907), U.S. Patent.
18. Sound and vibrational signals in the dance language of the honeybee, Apis mellifera10.1007/BF00290824 ↗
19. Intracolony vibroacoustic communication in social insects10.1007/s00040-013-0311-9 ↗
20. Zlatkova, A., Kokolanski, Z., and Tashkovski, D. (2020, January 16–18). Honeybees swarming detection approach by sound signal processing. Proceedings of the 2020 XXIX International Scientific Conference Electronics (ET), Sozopol, Bulgaria.10.1109/ET50336.2020.9238260 ↗
21. Žgank, A. (2018, January 21–23). Acoustic monitoring and classification of bee swarm activity using MFCC feature extraction and HMM acoustic modeling. Proceedings of the 2018 ELEKTRO, Mikulov, Czech Republic.10.1109/ELEKTRO.2018.8398253 ↗
22. (2021, October 31). A Closer Look: Piping, Tooting, Quacking. Available online: https://www.beeculture.com/a-closer-look-piping-tooting-quacking/.
23. The tooting and quacking vibration signals of honeybee queens: A quantitative analysis10.1007/BF00603817 ↗
24. Kirchner, W. (1997). Acoustical communication in social insects. Orientation and Communication in Arthropods, Springer.10.1007/978-3-0348-8878-3_10 ↗
25. Worker piping in honey bees (Apis mellifera): The behavior of piping nectar foragers10.1007/s00265-002-0567-y ↗
26. Worker piping associated with foraging in undisturbed queenright colonies of honey bees10.1051/apido:19960102 ↗
27. Worker piping in honey bee swarms and its role in preparing for liftoff10.1007/s00359-001-0243-0 ↗
28. Remote Beehive Monitoring Using Acoustic Signals
29. Worker piping triggers hissing for coordinated colony defence in the dwarf honeybee Apis florea10.1078/0944-2006-00064 ↗
30. The prediction of swarming in honeybee colonies using vibrational spectra10.1038/s41598-020-66115-5 ↗
31. Frequency Analysis of Honey Bee Buzz for Automatic Recognition of Health Status: A Preliminary Study10.13053/rcs-142-1-9 ↗
32. Farina, A., and Gage, S.H. (2017). The duality of sounds: Ambient and communication. Ecoacoustics, Wiley.10.1002/9781119230724 ↗
33. Electronic prediction of swarming in bees10.1038/184842a0 ↗
34. Woods, E.F. (1957). Means for Detecting and Indicating the Activities of Bees and Conditions in Beehives. (2806082A), U.S. Patent.
35. (2021, October 31). Apivox. Available online: https://apivox-smart-monitor.weebly.com/.
36. (2021, October 31). Bee Health Guru. Available online: https://www.beehealth.guru/.
37. (2021, October 31). Arnia. Available online: https://www.arnia.co/.
38. (2021, October 31). Nectar. Available online: https://www.nectar.buzz/.
39. Cecchi, S., Terenzi, A., Orcioni, S., Riolo, P., Ruschioni, S., and Isidoro, N. (2018, January 23–26). A preliminary study of sounds emitted by honey bees in a beehive. Proceedings of the Audio Engineering Society Convention 144, Milan, Italy.
40. (2021, October 13). Open Source Beehives Project. Available online: https://www.osbeehives.com/pages/about-us.
41. Kulyukin, V., Mukherjee, S., and Amlathe, P. (2018). Toward audio beehive monitoring: Deep learning vs. standard machine learning in classifying beehive audio samples. Appl. Sci., 8.10.3390/app8091573 ↗
42. Technological advances in field studies of pollinator ecology and the future of e-ecology10.1016/j.cois.2020.01.008 ↗
43. Generation, perception, and use of acoustic and electric fields in honeybee communication10.1134/S0006350913060067 ↗
44. Terenzi, A., Cecchi, S., and Spinsante, S. (2020). On the importance of the sound emitted by honey bee hives. Vet. Sci., 7.10.3390/vetsci7040168 ↗
45. Dubois, S., Choveton-Caillat, J., Kane, W., Gilbert, T., Nfaoui, M., El Boudali, M., Rezzouki, M., and Ferré, G. (2021, January 22–28). Bee Detection For Fruit Cultivation. Proceedings of the 2021 IEEE International Symposium on Circuits and Systems (ISCAS), Daegu, Korea.10.1109/ISCAS51556.2021.9401393 ↗
46. Heise, D., Miller-Struttmann, N., Galen, C., and Schul, J. (2017, January 11–13). Acoustic detection of bees in the field using CASA with focal templates. Proceedings of the 2017 IEEE Sensors Applications Symposium (SAS), Montréal, QC, Canada.10.1109/SAS.2017.7894089 ↗
47. Acoustic Scene Classification and Visualization of Beehive Sounds Using Machine Learning Algorithms and Grad-CAM10.1155/2021/5594498 ↗
48. Nolasco, I., and Benetos, E. (2018). To bee or not to bee: Investigating machine learning approaches for beehive sound recognition. arXiv.
49. Zhang, T., Zmyslony, S., Nozdrenkov, S., Smith, M., and Hopkins, B. (2021). Semi-Supervised Audio Representation Learning for Modeling Beehive Strengths. arXiv.
50. Ruvinga, S., Hunter, G.J., Duran, O., and Nebel, J.C. (2021, January 20–23). Use of LSTM Networks to Identify “Queenlessness” in Honeybee Hives from Audio Signals. Proceedings of the 2021 17th International Conference on Intelligent Environments (IE), Dubai, United Arab Emirates.10.1109/IE51775.2021.9486575 ↗
51. Peng, R., Ardekani, I., and Sharifzadeh, H. (2020, January 7–10). An Acoustic Signal Processing System for Identification of Queen-less Beehives. Proceedings of the 2020 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Online.
52. Terenzi, A., Cecchi, S., Orcioni, S., and Piazza, F. (2019, January 23–25). Features extraction applied to the analysis of the sounds emitted by honey bees in a beehive. Proceedings of the 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA), Dubrovnik, Croatia.10.1109/ISPA.2019.8868934 ↗
53. Nolasco, I., Terenzi, A., Cecchi, S., Orcioni, S., Bear, H.L., and Benetos, E. (2019, January 12–17). Audio-based identification of beehive states. Proceedings of the ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Brighton, UK.10.1109/ICASSP.2019.8682981 ↗
54. Comparison of Feature Extraction Methods for Sound-based Classification of Honey Bee Activity10.1109/TASLP.2021.3133194 ↗
55. Analysis of a multiclass classification problem by lasso logistic regression and singular value decomposition to identify sound patterns in queenless bee colonies10.1016/j.compag.2019.02.024 ↗
56. Cejrowski, T., Szymański, J., Mora, H., and Gil, D. (2018, January 19–21). Detection of the bee queen presence using sound analysis. Proceedings of the Asian Conference on Intelligent Information and Database Systems, Dong Hoi City, Vietnam.10.1007/978-3-319-75420-8_28 ↗
57. Signal processing the acoustics of honeybees (Apis mellifera) to identify the “queenless” state in Hives
58. Gatto, B.B., Colonna, J.G., Santos, E.M.D., Koerich, A.L., and Fukui, K. (2021). Discriminative Singular Spectrum Classifier with Applications on Bioacoustic Signal Recognition. arXiv.
59. Bee swarm detection based on comparison of estimated distributions samples of sound10.1109/TIM.2018.2878594 ↗
60. Anand, N., Raj, V.B., Ullas, M., and Srivastava, A. (2018, January 3–5). Swarm Detection and Beehive Monitoring System using Auditory and Microclimatic Analysis. Proceedings of the 2018 3rd International Conference on Circuits, Control, Communication and Computing (I4C), Bangalore, India.10.1109/CIMCA.2018.8739710 ↗
61. Zlatkova, A., Gerazov, B., Tashkovski, D., and Kokolanski, Z. (2020, January 15–16). Analysis of parameters in algorithms for signal processing for swarming of honeybees. Proceedings of the 2020 28th Telecommunications Forum (TELFOR), Belgrade, Serbia.10.1109/TELFOR51502.2020.9306562 ↗
62. Cecchi, S., Terenzi, A., Orcioni, S., and Piazza, F. (2019, January 16–19). Analysis of the sound emitted by honey bees in a beehive. Proceedings of the Audio Engineering Society Convention 147. Audio Engineering Society, New York, NY, USA.
63. Zgank, A. (2021). IoT-based bee swarm activity acoustic classification using deep neural networks. Sensors, 21.10.3390/s21030676 ↗
64. Zgank, A. (2020). Bee swarm activity acoustic classification for an IoT-based farm service. Sensors, 20.10.3390/s20010021 ↗
65. Hord, L., and Shook, E. (2022, March 10). Determining Honey Bee Behaviors from Audio Analysis. Available online: https://www.google.com.hk/url?sa=t&rct=j&q=&esrc=s&source=web&cd=&ved=2ahUKEwi77vbYhpD3AhUXx4sBHe3HBmgQFnoECAQQAQ&url=https%3A%2F%2Fcs.appstate.edu%2Fret%2Fpapers%2FDeterminingHoneyBeeBehaviorsAudioAnalysis.docx&usg=AOvVaw0mL2ZJS0YDGono-DYA_AcT.
66. Tashakkori, R., Buchanan, G.B., and Craig, L.M. (2020, January 12–15). Analyses of Audio and Video Recordings for Detecting a Honey Bee Hive Robbery. Proceedings of the 2020 SoutheastCon, Online.10.1109/SoutheastCon44009.2020.9249684 ↗
67. Soundscape Indices: New Features for Classifying Beehive Audio Samples10.13102/sociobiology.v67i4.5860 ↗
68. Based investigate of beehive sound to detect air pollutants by machine learning10.1016/j.ecoinf.2021.101246 ↗
69. Continuous monitoring of beehives’ sound for environmental pollution control10.1016/j.ecoleng.2016.01.082 ↗
70. Processing of multi-modal environmental signals recorded from a “smart” beehive
71. Precision apiculture: Development of a wireless sensor network for honeybee hives10.1016/j.compag.2018.11.001 ↗
72. Zubrzak, B., Bieńkowski, P., Cała, P., Płaskota, P., Rudno-Rudziński, K., and Nowakowski, P. (2018). Thermal and acoustic changes in bee colony due to exposure to microwave electromagnetic field–preliminary research. Przegląd Elektrotechniczny, 94.10.15199/48.2018.12.60 ↗
73. Sound recordings of Apis cerana japonica colonies over 24 h reveal unique daily hissing patterns10.1007/s13592-018-0631-x ↗
74. Hissing of A. cerana japonica is not only a direct aposematic response but also a frequent behavior during daytime10.1007/s00040-018-0617-8 ↗
75. Wehmann, H.N., Gustav, D., Kirkerud, N.H., and Galizia, C.G. (2015). The sound and the fury—Bees hiss when expecting danger. PLoS ONE, 10.10.1371/journal.pone.0118708 ↗
76. Long-Term and Extensive Monitoring for Bee Colonies Based on Internet of Things10.1109/JIOT.2020.2981681 ↗
77. Zacepins, A., Kviesis, A., Ahrendt, P., Richter, U., Tekin, S., and Durgun, M. (June, January 29). Beekeeping in the future—Smart apiary management. Proceedings of the 2016 17th International Carpathian Control Conference (ICCC), High Tatras, Slovakia.10.1109/CarpathianCC.2016.7501207 ↗
78. Murphy, F.E., Srbinovski, B., Magno, M., Popovici, E.M., and Whelan, P.M. (2015, January 24–25). An automatic, wireless audio recording node for analysis of beehives. Proceedings of the 2015 26th Irish Signals and Systems Conference (ISSC), Carlow, Ireland.10.1109/ISSC.2015.7163753 ↗
79. Development of a Low-Cost Wireless Bee-Hive Temperature and Sound Monitoring System
80. Automated classification of bees and hornet using acoustic analysis of their flight sounds10.1007/s13592-018-0619-6 ↗
81. Predicting species identity of bumblebees through analysis of flight buzzing sounds10.1080/09524622.2016.1190946 ↗
82. Gjoreski, M., Budna, B., Gradišek, A., and Gams, M. (2017, January 19–25). JSI Sound—A machine-learning tool in Orange for simple biosound classification. Proceedings of the 26th International Joint Conference on Artificial Intelligence, Melbourne, Australia.
83. Ribeiro, A.P., da Silva, N.F.F., Mesquita, F.N., Araújo, P.D.C.S., Rosa, T.C., and Mesquita-Neto, J.N. (2021). Machine learning approach for automatic recognition of tomato-pollinating bees based on their buzzing-sounds. PLoS Comput. Biol., 17.10.1371/journal.pcbi.1009426 ↗
84. Heise, D., Miller, Z., Wallace, M., and Galen, C. (June, January 25). Bumble Bee Traffic Monitoring Using Acoustics. Proceedings of the 2020 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Online.10.1109/I2MTC43012.2020.9129582 ↗
85. Heise, D., Miller, Z., Harrison, E., Gradišek, A., Grad, J., and Galen, C. (2019, January 11–13). Acoustically Tracking the Comings and Goings of Bumblebees. Proceedings of the 2019 IEEE Sensors Applications Symposium (SAS), Sophia Antipolis, France.10.1109/SAS.2019.8705973 ↗
86. Gradišek, A., Cheron, N., Heise, D., Galen, C., and Grad, J. (2018, January 10–14). Monitoring bumblebee daily activities using microphones. Proceedings of the 21st Annual International Multiconference Information Society–IS 2018, Ljubljana, Slovenia.
87. Van Goethem, S., Verwulgen, S., Goethijn, F., and Steckel, J. (2019, January 15–18). An IoT solution for measuring bee pollination efficacy. Proceedings of the 2019 IEEE 5th World Forum on Internet of Things (WF-IoT), Limerick, Ireland.10.1109/WF-IoT.2019.8767298 ↗
88. Miller-Struttmann, N.E., Heise, D., Schul, J., Geib, J.C., and Galen, C. (2017). Flight of the bumble bee: Buzzes predict pollination services. PLoS ONE, 12.10.1371/journal.pone.0179273 ↗
89. Buzz-based recognition of the honeybee colony circadian rhythm10.1016/j.compag.2020.105586 ↗
90. Pollination on the dark side: Acoustic monitoring reveals impacts of a total solar eclipse on flight behavior and activity schedule of foraging bees10.1093/aesa/say035 ↗
91. How well do acoustic recordings characterize properties of bee (Anthophila) floral sonication vibrations?10.1080/09524622.2018.1511474 ↗
92. Toward Sustainable Electronic Beehive Monitoring: Algorithms for Omnidirectional Bee Counting from Images and Harmonic Analysis of Buzzing Signals
93. The oligolectic bee Osmia brevis sonicates Penstemon flowers for pollen: A newly documented behavior for the Megachilidae10.1007/s13592-014-0286-1 ↗
94. Beeping and piping: Characterization of two mechano-acoustic signals used by honey bees in swarming10.1007/s00114-012-0990-5 ↗
95. Tayal, M., and Kariyat, R. (2021). Examining the Role of Buzzing Time and Acoustics on Pollen Extraction of Solanum elaeagnifolium. Plants, 10.10.3390/plants10122592 ↗
96. Buzz-based honeybee colony fingerprint10.1016/j.compag.2021.106489 ↗
97. What’s the Buzz About? Progress and Potential of Acoustic Monitoring Technologies for Investigating Bumble Bees10.1109/MIM.2021.9549234 ↗
98. Shakers and head bangers: Differences in sonication behavior between Australian Amegilla murrayensis (blue-banded bees) and North American Bombus impatiens (bumblebees)10.1007/s11829-015-9407-7 ↗
99. Comparison of pollination and defensive buzzes in bumblebees indicates species-specific and context-dependent vibrations10.1007/s00114-014-1161-7 ↗
100. Huber, P.J. (1992). Robust estimation of a location parameter. Breakthroughs in Statistics, Springer.10.1007/978-1-4612-4380-9_35 ↗