journal article·2025-03-25Open access

Automatic Detection and Unsupervised Clustering-Based Classification of Cetacean Vocal Signals

Yinian Liang, Yan Wang, Fangjiong Chen, Hua Yu, Fei Ji, Yankun Chen

Applied Sciences· Volume 15· Issue 7

Abstract

In the ocean environment, passive acoustic monitoring (PAM) is an important technique for the surveillance of cetacean species. Manual detection for a large amount of PAM data is inefficient and time-consuming. To extract useful features from a large amount of PAM data for classifying different cetacean species, we propose an automatic detection and unsupervised clustering-based classification method for cetacean vocal signals. This paper overcomes the limitations of the traditional threshold-based method, and the threshold is set adaptively according to the mean value of the signal energy in each frame. Furthermore, we also address the problem of the high cost of data training and labeling in deep-learning-based methods by using the unsupervised clustering-based classification method. Firstly, the automatic detection method extracts vocal signals from PAM data and, at the same time, removes clutter information. Then, the vocal signals are analyzed for classification using a clustering algorithm. This method grabs the acoustic characteristics of vocal signals and distinguishes them from environmental noise. We process 194 audio files in a total of 25.3 h of vocal signal from two marine mammal public databases. Five kinds of vocal signals from different cetaceans are extracted and assembled to form 8 datasets for classification. The verification experiments were conducted on four clustering algorithms based on two performance metrics. The experimental results confirm the effectiveness of the proposed method. The proposed method automatically removes about 75% of clutter data from 1581.3MB of data in audio files and extracts 75.75 MB of the features detected by our algorithm. Four classical unsupervised clustering algorithms are performed on the datasets we made for verification and obtain an average accuracy rate of 84.83%.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Marine animal studies overview · Animal Vocal Communication and Behavior · Speech and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510640, China

School of Computer Science and Engineering, South China University of Technology, Guangzhou 510640, China

Key Laboratory of Marine Environmental Survey Technology and Application, South China Sea Marine Survey and Technology Center of State Oceanic Administration (SMST), Ministry of Natural Resources, Guangzhou 510300, China

Funding

National Natural Science Foundation of China · Guangdong Basic and Applied Basic Research Foundation

References (59)

Show source-provided references
1. Braulik, G.T., Taylor, B.L., Minton, G., Notarbartolo di Sciara, G., Collins, T., Rojas-Bracho, L., Crespo, E.A., Ponnampalam, L.S., Double, M.C., and Reeves, R.R. (2023). Red-list status and extinction risk of the world’s whales, dolphins, and porpoises. Conserv. Biol., 37.10.1111/cobi.14090 ↗
2. An Overview of Fixed Passive Acoustic Observation Methods for Cetaceans10.5670/oceanog.2007.03 ↗
3. Zimmer, W.M. (2011). Passive Acoustic Monitoring of Cetaceans, Cambridge University Press.10.1017/CBO9780511977107 ↗
4. Acoustic classification of dolphins in the California Current using whistles, echolocation clicks, and burst pulses10.1111/mms.12381 ↗
5. Detection and classification of narrow-band high frequency echolocation clicks from drifting recorders10.1121/10.0001229 ↗
6. Au, W.W.L., and Lammers, M.O. (2016). Passive Acoustic Monitoring in Benthic Marine Crustaceans: A New Research Frontier. Listening in the Ocean, Springer.10.1007/978-1-4939-3176-7 ↗
7. Wiggins, S.M., and Hildebrand, J.A. (2007, January 17–20). High-frequency Acoustic Recording Package (HARP) for broad-band, long-term marine mammal monitoring. Proceedings of the 2007 Symposium on Underwater Technology and Workshop on Scientific Use of Submarine Cables and Related Technologies, Tokyo, Japan.10.1109/UT.2007.370760 ↗
8. An acoustic survey for sperm whales in the Southern Ocean Sanctuary conducted from the RSV Aurora Australis
9. Detection of sperm whale clicks based on the Teager–Kaiser energy operator10.1016/j.apacoust.2006.05.007 ↗
10. Classification of dolphin echolocation clicks by energy and frequency distributions10.1121/1.427153 ↗
11. The energy ratio mapping algorithm: A tool to improve the energy-based detection of odontocete echolocation clicks10.1121/1.3531924 ↗
12. Gong, W., Tian, J., Liu, J., and Li, B. (2023). Underwater Object Classification in SAS Images Based on a Deformable Residual Network and Transfer Learning. Appl. Sci., 13.10.3390/app13020899 ↗
13. Ji, F., Li, G., Lu, S., and Ni, J. (2024). Research on a Feature Enhancement Extraction Method for Underwater Targets Based on Deep Autoencoder Networks. Appl. Sci., 14.10.3390/app14041341 ↗
14. ImageNet classification with deep convolutional neural networks10.1145/3065386 ↗
15. Convolutional neural network for detecting odontocete echolocation clicks10.1121/1.5085647 ↗
16. Classification of odontocete echolocation clicks using convolutional neural network10.1121/10.0000514 ↗
17. Automatic detection and classification of baleen whale social calls using convolutional neural networks10.1121/10.0005047 ↗
18. Gaussian mixture model classification of odontocetes in the Southern California Bight and the Gulf of California10.1121/1.2400663 ↗
19. Comparison of Machine Learning Techniques for the Classification of Echolocation Clicks from Three Species of Odontocetes
20. Luo, W., Yang, W., Song, Z., and Zhang, Y. (2017, January 22–25). Automatic species recognition using echolocation clicks from odontocetes. Proceedings of the 2017 IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), Xiamen, China.10.1109/ICSPCC.2017.8242503 ↗
21. Using context to train time-domain echolocation click detectors10.1121/10.0004992 ↗
22. Clicks classification of sperm whale and long-finned pilot whale based on continuous wavelet transform and artificial neural network10.1016/j.apacoust.2018.06.014 ↗
23. Unsupervised clustering of toothed whale species from echolocation clicks10.1121/1.4970506 ↗
24. Automated identification and clustering of subunits within delphinid vocalizations10.1111/mms.12303 ↗
25. Description and clustering of echolocation signals of Commerson’s dolphins (Cephalorhynchus commersonii) in Bahía San Julián, Argentina10.1121/1.4929899 ↗
26. Model-based unsupervised clustering for distinguishing Cuvier’s and Gervais’ beaked whales in acoustic data10.1016/j.ecoinf.2020.101094 ↗
27. Species-level classification of beaked whale echolocation signals detected in the northern Gulf of Mexico10.1121/1.5047435 ↗
28. Frasier, K.E., Roch, M.A., Soldevilla, M.S., Wiggins, S.M., Garrison, L.P., and Hildebrand, J.A. (2017). Automated classification of dolphin echolocation click types from the Gulf of Mexico. PLoS Comput. Biol., 13.10.1371/journal.pcbi.1005823 ↗
29. Deep embedded clustering of coral reef bioacoustics10.1121/10.0004221 ↗
30. MobySound: A reference archive for studying automatic recognition of marine mammal sounds10.1016/j.apacoust.2006.06.002 ↗
31. Watkins, W.A., Fristrup, K., Daher, M.A., and Howald, T.J. (1992). Sound Database of Marine Animal Vocalizations Structure and Operations, Woods Hole Oceanographic Institution.10.1575/1912/854 ↗
32. Li, M.M., Yang, H.W., Hong, N., and Yang, S. (December, January 29). Endpoint detection based on EMD in noisy environment. Proceedings of the 2011 6th International Conference on Computer Sciences and Convergence Information Technology (ICCIT), Seogwipo, Republic of Korea.
33. Liang, Y., Chen, F., Yu, H., Chen, Y., and Ji, F. (2023, January 26–28). An EMD Based Automatic Endpoint Detection Method for Cetacean Vocal Signals. Proceedings of the 2023 IEEE International Conference on Electrical, Automation and Computer Engineering (ICEACE), Changchun, China.10.1109/ICEACE60673.2023.10442353 ↗
34. Rabiner, L., and Schafer, R. (2010). Theory and Applications of Digital Speech Processing, Prentice Hall Press.
35. Arthur, D., and Vassilvitskii, S. (2006). k-Means++: The Advantages of Careful Seeding, Stanford InfoLab. Technical Report 2006-13.
36. Two-dimensional PCA: A new approach to appearance-based face representation and recognition10.1109/TPAMI.2004.1261097 ↗
37. Sparse subspace clustering: Algorithm, theory, and applications10.1109/TPAMI.2013.57 ↗
38. Liu, J., Cai, D., and He, X. (2010, January 11–15). Gaussian mixture model with local consistency. Proceedings of the AAAI Conference on Artificial Intelligence, Atlanta, GA, USA.
39. Clustering and classification for time series data in visual analytics: A survey10.1109/ACCESS.2019.2958551 ↗
40. Yang, K., and Shahabi, C. (2004, January 13). A PCA-based similarity measure for multivariate time series. Proceedings of the 2nd ACM International Workshop on Multimedia Databases, Washington, DC, USA.10.1145/1032604.1032616 ↗
41. Comparison of passive acoustic soniferous fish monitoring with supervised and unsupervised approaches10.1121/1.5034169 ↗
42. Hidden Markov and Gaussian mixture models for automatic call classification10.1121/1.3124659 ↗
43. Using Gaussian mixture models to detect and classify dolphin whistles and pulses10.1121/1.4876439 ↗
44. Image super-resolution via sparse representation10.1109/TIP.2010.2050625 ↗
45. Joint learning framework of superpixel generation and fuzzy sparse subspace clustering for color image segmentation10.1016/j.sigpro.2024.109515 ↗
46. Song, S., Ren, D., Jia, Z., and Shi, F. (2024, January 14–19). Adaptive Gaussian Regularization Constrained Sparse Subspace Clustering for Image Segmentation. Proceedings of the ICASSP 2024—2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Republic of Korea.10.1109/ICASSP48485.2024.10446289 ↗
47. Razik, J., Glotin, H., Hoeberechts, M., Doh, Y., and Paris, S. (2015, January 14–17). Sparse coding for efficient bioacoustic data mining: Preliminary application to analysis of whale songs. Proceedings of the 2015 IEEE International Conference on Data Mining Workshop (ICDMW), Atlantic City, NJ, USA.10.1109/ICDMW.2015.232 ↗
48. Sparse representation for computer vision and pattern recognition10.1109/JPROC.2010.2044470 ↗
49. Sparse subspace clustering via low-rank structure propagation10.1016/j.patcog.2019.06.019 ↗
50. Sparse subspace clustering incorporated deep convolutional transform learning for hyperspectral band selection10.1007/s12145-024-01312-8 ↗
51. Semi-supervised sparse subspace clustering with manifold regularization10.1007/s10489-024-05535-6 ↗
52. Dynamic sparse subspace clustering for evolving high-dimensional data streams10.1109/TCYB.2020.3023973 ↗
53. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness and correlation
54. Sensing frequency drifts: A lookup table approach10.1109/ACCESS.2022.3203187 ↗
55. Multi-jump resonance systems10.1080/00207179.2018.1535185 ↗
56. Empirical mode decomposition-based time-frequency analysis of multivariate signals: The power of adaptive data analysis10.1109/MSP.2013.2267931 ↗
57. Kaiser, J. (1990, January 3–6). On a simple algorithm to calculate the ‘energy’ of a signal. Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Albuquerque, NM, USA.
58. Junqua, J.C., Reaves, B., and Mak, B. (1991, January 24–26). A study of endpoint detection algorithms in adverse conditions: Incidence on a DTW and HMM recognizer. Proceedings of the Eurospeech, Genova, Italy.10.21437/Eurospeech.1991-313 ↗
59. Giannakopoulos, T., and Pikrakis, A. (2014). Introduction to Audio Analysis Chapter 4—Audio Features, Academic Press.10.1016/B978-0-08-099388-1.00004-2 ↗