journal article·2025-01-09Open access

ASDNet: An Efficient Self-Supervised Convolutional Network for Anomalous Sound Detection

Dewei Kong, Guoshun Yuan, Hongjiang Yu, Shuai Wang, Bo Zhang

Applied Sciences· Volume 15· Issue 2

Abstract

Anomalous Sound Detection (ASD) is crucial for ensuring industrial equipment safety and enhancing production efficiency. However, existing methods, while pursuing high detection accuracy, are often associated with high computational complexity, making them unsuitable for resource-constrained environments. This study proposes an efficient self-supervised ASD framework that integrates spectral features, lightweight neural networks, and various anomaly scoring methods. Unlike traditional Log-Mel features, spectral features retain richer frequency domain details, providing high-quality inputs that enhance detection accuracy. The framework includes two network architectures: the lightweight ASDNet, optimized for resource-limited scenarios, and SpecMFN, which combines SpecNet and MobileFaceNet for advanced feature extraction and classification. These architectures employ various anomaly scoring methods, enabling complex decision boundaries to effectively detect diverse anomalous patterns. Experimental results demonstrate that ASDNet achieves an average AUC of 94.42% and a pAUC of 87.18%, outperforming existing methods by 6.75% and 9.34%, respectively, while significantly reducing FLOPs (85.4 M, a 93.81% reduction) and parameters (0.51 M, a 41.38% reduction). SpecMFN achieves AUC and pAUC values of 94.36% and 88.60%, respectively, with FLOPs reduced by 86.6%. These results highlight the framework’s ability to balance performance and computational efficiency, making it a robust and practical solution for ASD tasks in industrial and resource-constrained environments.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Water Systems and Optimization · Music and Audio Processing

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Microelectronics of the Chinese Academy of Sciences, Beijing 100029, China

University of Chinese Academy of Sciences, Beijing 101408, China

References (45)

Show source-provided references
1. A survey of network anomaly detection techniques10.1016/j.jnca.2015.11.016 ↗
2. Anomalous sound detection for industrial machines using acoustical features related to timbral metrics10.1109/ACCESS.2023.3294334 ↗
3. Machine learning and IoT-based approach for tool condition monitoring: A review and future prospects10.1016/j.measurement.2022.112351 ↗
4. Toward new-generation intelligent manufacturing10.1016/j.eng.2018.01.002 ↗
5. “Industrie 4.0” and smart manufacturing-a review of research issues and application examples10.20965/ijat.2017.p0004 ↗
6. Big data in cyber-physical systems, digital manufacturing and industry 4.0
7. Koizumi, Y., Kawaguchi, Y., Imoto, K., Nakamura, T., Nikaido, Y., Tanabe, R., Purohit, H., Suefusa, K., Endo, T., and Yasuda, M. (2020, January 2–4). Description and Discussion on DCASE2020 Challenge Task2: Unsupervised Anomalous Sound Detection for Machine Condition Monitoring. Proceedings of the Detection and Classification of Acoustic Scenes and Events 2020 Workshop (DCASE2020), Tokyo, Japan.
8. Suefusa, K., Nishida, T., Purohit, H., Tanabe, R., Endo, T., and Kawaguchi, Y. (2020, January 4–8). Anomalous sound detection based on interpolation deep neural network. Proceedings of the ICASSP 2020—2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.10.1109/ICASSP40776.2020.9054344 ↗
9. Kapka, S. (2020). ID-conditioned auto-encoder for unsupervised anomaly detection. arXiv.
10. Alam, J., Boulianne, G., Gupta, V., and Fathan, A. (2020, January 2–4). An ensemble approach to unsupervised anomalous sound detection. Proceedings of the 5th Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE), Tokyo, Japan.
11. Daniluk, P., Gozdziewski, M., Kapka, S., and Kosmider, M. (2020, January 2–4). Ensemble of auto-encoder based systems for anomaly detection. Proceedings of the Detection and Classification of Acoustic Scenes and Events 2020 Workshop (DCASE2020), Tokyo, Japan. Technical Report.
12. Hayashi, T., Yoshimura, T., and Adachi, Y. (2020, January 2–4). Conformer-based id-aware autoencoder for unsupervised anomalous sound detection. Proceedings of the Detection and Classification of Acoustic Scenes and Events 2020 Workshop (DCASE2020), Tokyo, Japan. Technical Report.
13. Liu, Y., Guan, J., Zhu, Q., and Wang, W. (2022, January 23–27). Anomalous sound detection using spectral-temporal information fusion. Proceedings of the ICASSP 2022-2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Singapore.10.1109/ICASSP43922.2022.9747868 ↗
14. Chen, H., Ran, L., Sun, X., and Cai, C. (2023, January 4–10). SW-WAVENET: Learning representation from spectrogram and WaveGram using WaveNet for anomalous sound detection. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096742 ↗
15. Choi, S., and Choi, J.W. (2024, January 14–19). Noisy-Arcmix: Additive Noisy Angular Margin Loss Combined with Mixup For Anomalous Sound Detection. Proceedings of the ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Republic of Korea.10.1109/ICASSP48485.2024.10447764 ↗
16. Multi-Spectral and Multi-Temporal Features Fusion with SE Network for Anomalous Sound Detection10.1109/ACCESS.2024.3496543 ↗
17. Dohi, K., Endo, T., Purohit, H., Tanabe, R., and Kawaguchi, Y. (2021, January 6–11). Flow-based self-supervised density estimation for anomalous sound detection. Proceedings of the ICASSP 2021—2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9414662 ↗
18. Zeng, X.M., Song, Y., Zhuo, Z., Zhou, Y., Li, Y.H., Xue, H., Dai, L.R., and McLoughlin, I. (2023, January 4–10). Joint generative-contrastive representation learning for anomalous sound detection. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10095568 ↗
19. Unsupervised anomalous sound detection for industrial monitoring based on ArcFace classifier and gaussian mixture model10.1016/j.apacoust.2022.109188 ↗
20. Speaker Recognition by Machines and Humans: A tutorial review10.1109/MSP.2015.2462851 ↗
21. Classification of multi-type bearing fault features based on semi-supervised generative adversarial network (GAN)10.1088/1361-6501/ad068e ↗
22. Wilkinghoff, K. (2023, January 4–10). Design choices for learning embeddings from auxiliary tasks for domain generalization in anomalous sound detection. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10097176 ↗
23. Zhang, H., Guan, J., Zhu, Q., Xiao, F., and Liu, Y. (2023, January 20-24). Anomalous Sound Detection Using Self-Attention-Based Frequency Pattern Analysis of Machine Sounds. Proceedings of the INTERSPEECH 2023, Dublin, Ireland.10.21437/Interspeech.2023-2416 ↗
24. Wang, M., Mei, Q., Song, X., Liu, X., Kan, R., Yao, F., Xiong, J., and Qiu, H. (2023). A Machine Anomalous Sound Detection Method Using the lMS Spectrogram and ES-MobileNetV3 Network. Appl. Sci., 13.10.3390/app132312912 ↗
25. Zeng, Y., Liu, H., Xu, L., Zhou, Y., and Gan, L. (2022, January 3–4). Robust Anomaly Sound Detection Framework for Machine Condition Monitoring. Proceedings of the IEEE AASP Challenge on Detection and Classification of Acoustic Scenes and Events, Nancy, France. Technical Report.
26. Ravanelli, M., and Bengio, Y. (2018, January 18–21). Speaker recognition from raw waveform with sincnet. Proceedings of the 2018 IEEE spoken language technology workshop (SLT), Athens, Greece.10.1109/SLT.2018.8639585 ↗
27. Bai, J., Chen, C., and Chen, J. Bai_LFXS_NWPU_dcase2020_submission. Proceedings of the In Proceedings of the Detection and Classification of Acoustic Scenes and Events 2020 Workshop (DCASE2020), Tokyo, Japan, 2–4 November 2020, Technical Report.
28. Chen, S., Wang, J., Wang, J., and Xu, Z. (2023). MDAM: Multi-Dimensional Attention Module for Anomalous Sound Detection. International Conference on Neural Information Processing, Springer.10.1007/978-981-99-8178-6_4 ↗
29. Chen, S., Liu, Y., Gao, X., and Han, Z. (2018, January 11–12). Mobilefacenets: Efficient cnns for accurate real-time face verification on mobile devices. Proceedings of the Biometric Recognition: 13th Chinese Conference, CCBR 2018, Urumqi, China. Proceedings 13.10.1007/978-3-319-97909-0_46 ↗
30. Wilkinghoff, K. (2021, January 18–22). Sub-cluster AdaCos: Learning representations for anomalous sound detection. Proceedings of the 2021 International Joint Conference on Neural Networks (IJCNN), Shenzhen, China.10.1109/IJCNN52387.2021.9534290 ↗
31. Targ, S., Almeida, D., and Lyman, K. (2016). Resnet in resnet: Generalizing residual architectures. arXiv.
32. Van Den Oord, A., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). Wavenet: A generative model for raw audio. arXiv.
33. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (2019, January 27–29). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.10.1109/ICCV.2019.00140 ↗
34. Learning the k in k-means
35. Gaussian mixture models
36. Breunig, M.M., Kriegel, H.P., Ng, R.T., and Sander, J. (2000, January 15–18). LOF: Identifying density-based local outliers. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335388 ↗
37. Learning similarity with cosine similarity ensemble10.1016/j.ins.2015.02.024 ↗
38. Zhang, H., Cisse, M., Dauphin, Y.N., and Lopez-Paz, D. (2017). mixup: Beyond empirical risk minimization. arXiv.10.1007/978-1-4899-7687-1_79 ↗
39. Guan, J., Xiao, F., Liu, Y., Zhu, Q., and Wang, W. (2023, January 4–10). Anomalous sound detection using audio representation with machine ID based contrastive learning pretraining. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096054 ↗
40. Signal estimation from modified short-time Fourier transform10.1109/TASSP.1984.1164317 ↗
41. Guan, J., Liu, Y., Zhu, Q., Zheng, T., Han, J., and Wang, W. (2023, January 4–10). Time-weighted frequency domain audio representation with GMM estimator for anomalous sound detection. Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10096356 ↗
42. Multilingual Customized Keyword Spotting Using Similar-Pair Contrastive Learning10.1109/TASLP.2023.3284523 ↗
43. An unsupervised machine learning algorithms: Comprehensive review10.12785/ijcds/130172 ↗
44. Koizumi, Y., Saito, S., Uematsu, H., Harada, N., and Imoto, K. (2019, January 20–23). ToyADMOS: A dataset of miniature-machine operating sounds for anomalous sound detection. Proceedings of the 2019 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, USA.10.1109/WASPAA.2019.8937164 ↗
45. Purohit, H., Tanabe, R., Ichige, K., Endo, T., Nikaido, Y., Suefusa, K., and Kawaguchi, Y. (2019). MIMII Dataset: Sound dataset for malfunctioning industrial machine investigation and inspection. arXiv.10.33682/m76f-d618 ↗