journal article·2019-06Open access

Machine auscultation: enabling machine diagnostics using convolutional neural networks and large-scale machine audio data

Ruo-Yu Yang, Rahul Rai

Advances in Manufacturing· Volume 7· Issue 2

Abstract

Acoustic signals play an essential role in machine state monitoring. Efficient processing of real-time machine acoustic signals improves production quality. However, generating semantically useful information from sound signals is an ill-defined problem that exhibits a highly non-linear relationship between sound and subjective perceptions. This paper outlines two neural network models to analyze and classify acoustic signals emanating from machines: (i) a backpropagation neural network (BP-NN); and (ii) a convolutional neural network (CNN). Microphones are used to collect acoustic data for training models from a computer numeric control (CNC) lathe. Numerical experiments demonstrate that CNN performs better than the BP-NN.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Music and Audio Processing · Machine Fault Diagnosis Techniques · Phonocardiography and Auscultation Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (46)

Show source-provided references
1. Huang HB, Huang XR, Li RX et al (2016) Sound quality prediction of vehicle interior noise using deep belief networks. Appl Acoust 113:149–16110.1016/j.apacoust.2016.06.021 ↗
2. Sharan RV, Moir TJ (2016) An overview of applications and advancements in automatic sound recognition. Neurocomputing 200:22–3410.1016/j.neucom.2016.03.020 ↗
3. Kumon M, Yoshihiro ITO, Nakashima T et al (2007) Sound source classification using support vector machine. IFAC Proc Vol 40(13):465–47010.3182/20070829-3-RU-4911.00072 ↗
4. Thaler T, Potočnik P, Bric I et al (2014) Chatter detection in band sawing based on discriminant analysis of sound features. Appl Acoust 77:114–12110.1016/j.apacoust.2012.12.004 ↗
5. Dombovari Z, Barton DAW, Wilson RE et al (2011) On the global dynamics of chatter in the orthogonal cuttingmodel. Int J Non-lin Mech 46(1):330–33810.1016/j.ijnonlinmec.2010.09.016 ↗
6. Pan G, Xu H, Kwan CM et al (1996) Modeling and intellligent chatter control strategies for a lathe machine. Control Eng Pract 4(12):1647–165810.1016/S0967-0661(96)00182-7 ↗
7. https://github.com/ruoyuyang1991/machine-auscultation-classification . Accessed 10 April 2019
8. Singh KK, Singh R, Kartik V (2015) Comparative study of chatter detection methods for high-speed micromilling of Ti6Al4V. Proc Manufacturing 1(1):593–60610.1016/j.promfg.2015.09.040 ↗
9. Li XQ, Wong YS, Nee AYC (1997) Tool wear and chatter detection using the coherence function of two crossed accelerations. Int J Mach Tools Manuf 37(4):425–43510.1016/S0890-6955(96)00030-2 ↗
10. Kuljanic E, Sortino M, Totis G (2008) Multisensor approaches for chatter detection in milling. J Sound Vib 312(4–5):672–69310.1016/j.jsv.2007.11.006 ↗
11. Toh CK (2004) Vibration analysis in high speed rough and finish milling hardened steel. J Sound Vib 278(1):101–11510.1016/j.jsv.2003.11.012 ↗
12. Soliman E, Ismail F (1997) Chatter detection by monitoring spindle drive current. Int J Adv Manuf Technol 13(1):27–3410.1007/BF01179227 ↗
13. Delio T, Tlusty J, Smith S (1992) Use of audio signals for chatter detection and control. J Manuf Sci Eng 114(2):146–15710.1115/1.2899767 ↗
14. Li XQ, Wong YS, Nee AYC (1988) A comprehensive identification of tool failure and chatter using a parallel multi-art2 neural network. J Manuf Sci Eng 120(2):433–44210.1115/1.2830144 ↗
15. Jiang AY, Zhang C (2006) Hybrid HMM/SVM method for predicting cutting chatter. In: Proceedings of SPIE–the international society for optical engineering 6280:62801Q-810.1117/12.716150 ↗
16. Yao ZH, Mei DQ, Chen ZC (2010) On-line chatter detection and identification based on wavelet and support vector machine. J Mater Process Technol 210(5):713–71910.1016/j.jmatprotec.2009.11.007 ↗
17. Bediaga I, Munoa J, Hernández J et al (2009) An automatic spindle speed selection strategy to obtain stability in high-speed milling. Int J Mach Tools Manuf 49(5):384–39410.1016/j.ijmachtools.2008.12.003 ↗
18. Zhang CL, Yue X, Jiang YT (2010) A hybrid approach of ann and hmm for cutting chatter monitoring. Adv Mater Res 97:3225–323210.4028/www.scientific.net/AMR.97-101.3225 ↗
19. Cao HR, Lei YG, He ZJ (2013) Chatter identification in end milling process using wavelet packets and hilbert–huang transform. Int J Mach Tools Manuf 69:11–1910.1016/j.ijmachtools.2013.02.007 ↗
20. Kondo E, Ota H, Kawai T (1997) A new method to detect regenerative chatter using spectral analysis, part 1: Basic study on criteria for detection of chatter. J Manuf Sci Eng 119(4A):461–46610.1115/1.2831175 ↗
21. Tansel IN, Wang X, Chen P et al (2006) Transformations in machining. Part 2: evaluation of machining quality and detection of chatter in turning by using s-transformation. Int J Mach Tools Manuf 46(1):43–5010.1016/j.ijmachtools.2005.04.011 ↗
22. Cho DW, Eman KF (1988) Pattern recognition for on- line chatter detection. Mech Syst Signal Process 2(3):279–29010.1016/0888-3270(88)90024-6 ↗
23. Grabec I, Gradišek J, Govekar E (1999) A new method for chatter detection in turning. CIRP Ann Manuf Technol 48(1):29–3210.1016/S0007-8506(07)63125-4 ↗
24. Berger B, Belai C, Anand D (2003) Chatter identification with mutual information. J Sound Vib 267(1):178–18610.1016/S0022-460X(03)00067-1 ↗
25. Choi T, Shin YC (2003) On-line chatter detection using wavelet-based parameter estimation. Trans-Am Soc Mech Eng J Manuf Sci Eng 125(1):21–2810.1115/1.1531113 ↗
26. Lécun Y, Bottou L, Bengio Y et al (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–232410.1109/5.726791 ↗
27. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 1:1097–1105
28. Simonyan K, Zisserman A (2014) Very deep convo- lutional networks for large-scale image recognition. arXiv preprint arXiv:1409–1556
29. Szegedy C, Liu W, Jia YQ er al (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–910.1109/CVPR.2015.7298594 ↗
30. Girshick R, Donahue J, Darrell T (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–58710.1109/CVPR.2014.81 ↗
31. Girshick R (2015) Fast R-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 1440–144810.1109/ICCV.2015.169 ↗
32. Ren SQ, He KM, Girshick R et al (2015) Faster R-CNN: Towards real-time object detection with region proposal networks. Adv Neural Inform Process Syst 1:91–99
33. Lécun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–44410.1038/nature14539 ↗
34. Piczak KJ (2015) Environmental sound classification with convolutional neural networks. In: IEEE 25th International workshop on machine learning for signal processing (MLSP), 2015, pp 1–610.1109/MLSP.2015.7324337 ↗
35. Boddapatia V, Petef A, Rasmusson J et al (2017) Classifying environmental sounds using image recognition networks. Proc Comput Sci 112:2048–205610.1016/j.procs.2017.08.250 ↗
36. Fu Y, Zhang Y, Gao Y et al (2017) Machining vibration states monitoring based on image representation using convolutional neural networks. Eng Appl Artif Intell 65:240–25110.1016/j.engappai.2017.07.024 ↗
37. Loh WL (1996) On latin hypercube sampling. Ann Stat 24(5):2058–208010.1214/aos/1069362310 ↗
38. Vaseghi SV (2008) Advanced digital signal processing and noise reduction. Wiley, New York10.1002/9780470740156 ↗
39. Gupta CN, Palaniappan R, Swaminathan S et al (2007) Neural network classification of homomorphic segmented heart sounds. Appl Soft Comput 7(1):286–29710.1016/j.asoc.2005.06.006 ↗
40. Kotani M, Katsura M, Ozawa S (2004) Detection of gas leakage sound using modular neural networks for unknown environments. Neurocomputing 62:427–44010.1016/j.neucom.2004.06.002 ↗
41. Potočnik P, Thaler T, Govekar E (2013) Multisensory chatter detection in band sawing. Proc CIRP 8:469–47410.1016/j.procir.2013.06.135 ↗
42. Liang HY, Nartimo I (1998) A feature extraction algorithm based on wavelet packet decomposition for heart sound signals. In: Proceedings of the IEEE-SP international symposium, pp 93–96
43. Babaei S, Geranmayeh A (2009) Heart sound reproduction based on neural network classification of cardiac valve disorders using wavelet transforms of pcg signals. Comput Biol Med 39(1):8–1510.1016/j.compbiomed.2008.10.004 ↗
44. O’shaughnessy D (1987) Speech communication: human and machine. Universities Press, Hyderabad
45. Krizhevsky A, Hinton G (2009) Learning multiple layers of features from tiny images. Technical report, University of Toronto 1(4):7
46. Srivastava N, Hinton G, Krizhevsky A et al (2014) Dropout: A simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958