2023-02-25

Denoising Fault-Aware Wavelet Network: A Signal Processing Informed Neural Network for Fault Diagnosis

  • Zuogang Shang ,
  • Zhibin Zhao ,
  • Ruqiang Yan
Expand
  • The State Key Laboratory for Manufacturing Systems Engineering, Xi'an Jiaotong University, Xi'an 710049, China

Received date: 2022-10-12

  Revised date: 2022-12-14

  Online published: 2023-12-20

Supported by

Supported by National Natural Science Foundation of China (Grant Nos. 51835009, 52105116) and China Postdoctoral Science Foundation (Grant Nos. 2021M692557, 2021TQ0263)

Abstract

Deep learning (DL) is progressively popular as a viable alternative to traditional signal processing (SP) based methods for fault diagnosis. However, the lack of explainability makes DL-based fault diagnosis methods difficult to be trusted and understood by industrial users. In addition, the extraction of weak fault features from signals with heavy noise is imperative in industrial applications. To address these limitations, inspired by the Filterbank-Feature-Decision methodology, we propose a new Signal Processing Informed Neural Network (SPINN) framework by embedding SP knowledge into the DL model. As one of the practical implementations for SPINN, a denoising fault-aware wavelet network (DFAWNet) is developed, which consists of fused wavelet convolution (FWConv), dynamic hard thresholding (DHT), index-based soft filtering (ISF), and a classifier. Taking advantage of wavelet transform, FWConv extracts multiscale features while learning wavelet scales and selecting important wavelet bases automatically; DHT dynamically eliminates noise-related components via point-wise hard thresholding; inspired by index-based filtering, ISF optimizes and selects optimal filters for diagnostic feature extraction. It's worth noting that SPINN may be readily applied to different deep learning networks by simply adding filterbank and feature modules in front. Experiments results demonstrate a significant diagnostic performance improvement over other explainable or denoising deep learning networks. The corresponding code is available at https://github.com/albertszg/DFAWnet.

Cite this article

Zuogang Shang , Zhibin Zhao , Ruqiang Yan . Denoising Fault-Aware Wavelet Network: A Signal Processing Informed Neural Network for Fault Diagnosis[J]. Chinese Journal of Mechanical Engineering, 2023 , 36(1) : 9 -9 . DOI: 10.1186/s10033-023-00838-0

References

[1] Z Zhao, S Wu, B Qiao, et al. Enhanced sparse period-group lasso for bearing fault diagnosis. IEEE Transactions on Industrial Electronics, 2018, 66(3): 2143-2153.
[2] L Liao, W Jin, R Pavel. Enhanced restricted Boltzmann machine with prognosability regularization for prognostics and health assessment. IEEE Transactions on Industrial Electronics, 2016, 63(11): 7076-7083.
[3] X Chen, M Ma, Z Zhao, et al. Physics-informed deep neural network for bearing prognosis with multi-sensory signals. Journal of Dynamics, Monitoring and Diagnostics, 2022, 1(4): 200-207.
[4] W Zhao, C Zhang, S Wang, et al. Rolling bearing remaining useful life prediction based on wiener process. Journal of Dynamics, Monitoring and Diagnostics, 2022, 1(4): 229-236.
[5] H Chen, R Liu, Z Xie, et al. Majorities help minorities: Hierarchical structure guided transfer learning for few-shot fault recognition. Pattern Recognition, 2022, 123: 108383.
[6] R Liu, B Yang, E Zio, et al. Artificial intelligence for fault diagnosis of rotating machinery: A review. Mechanical Systems and Signal Processing, 2018, 108: 33-47.
[7] S Li, Y Xin, X Li, et al. A review on the signal processing methods of rotating machinery fault diagnosis. 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), IEEE, 2019: 1559-1565.
[8] J Antoni. A critical overview of the "Filterbank-Feature-Decision" methodology in machine condition monitoring. Acoustics Australia, 2021, 49(2): 177-184.
[9] R Yan, R X Gao, X Chen. Wavelets for fault diagnosis of rotary machines: A review with applications. Signal Processing, 2014, 96: 1-15.
[10] J Chen, Y Zi, Z He, et al. Compound faults detection of rotating machinery using improved adaptive redundant lifting multiwavelet. Mechanical Systems and Signal Processing, 2013, 38(1): 36-54.
[11] R Yan, M Shan, J Cui, et al. Mutual information-assisted wavelet function selection for enhanced rolling bearing fault diagnosis. Shock and Vibration, 2015: 1-9
[12] D Wang. Some further thoughts about spectral kurtosis, spectral L2/L1 norm, spectral smoothness index and spectral Gini index for characterizing repetitive transients. Mechanical Systems and Signal Processing, 2018, 108: 360-368.
[13] Y Lei, B Yang, X Jiang, et al. Applications of machine learning to machine fault diagnosis: A review and roadmap. Mechanical Systems and Signal Processing, 2020, 138: 106587.
[14] J Wu, Z Zhao, C Sun, et al. Few-shot transfer learning for intelligent fault diagnosis of machine. Measurement, 2020, 166: 108202.
[15] R Liu, F Wang, B Yang, et al. Multiscale kernel based residual convolutional neural network for motor fault diagnosis under nonstationary conditions. IEEE Transactions on Industrial Informatics, 2019, 16(6): 3797-3806.
[16] X Yu, Z Zhao, X Zhang, et al. Deep-learning-based open set fault diagnosis by extreme value theory. IEEE Transactions on Industrial Informatics, 2021, 18(1): 185-196.
[17] D Gunning, M Stefik, J Choi, et al. XAI—Explainable artificial intelligence. Science Robotics, 2019, 4(37): eaay7120.
[18] Z Ye, J Yu. Deep morphological convolutional network for feature learning of vibration signals and its applications to gearbox fault diagnosis. Mechanical Systems and Signal Processing, 2021, 161: 107984.
[19] T Li, Z Zhao, C Sun, et al. WaveletKernelNet: An interpretable deep neural network for industrial intelligent diagnosis. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2021, 52(4): 2302-2312.
[20] J Yuan, S Cao, G Ren, et al. LW-Net: an interpretable network with smart lifting wavelet kernel for mechanical feature extraction and fault diagnosis. Neural Computing and Applications, 2022, 34(18): 15661-15672.
[21] D Wang, Y Chen, C Shen, et al. Fully interpretable neural network for locating resonance frequency bands for machine condition monitoring. Mechanical Systems and Signal Processing, 2022, 168: 108673.
[22] G Michau, G Frusque, O Fink. Fully learnable deep wavelet transform for unsupervised monitoring of high-frequency time series. Proceedings of the National Academy of Sciences, 2022, 119(8): e2106598119.
[23] M Zhao, S Zhong, X Fu, et al. Deep residual shrinkage networks for fault diagnosis. IEEE Transactions on Industrial Informatics, 2019, 16(7): 4681-4690.
[24] D L Donoho. De-noising by soft-thresholding. IEEE Transactions on Information Theory, 1995, 41(3): 613-627.
[25] R Yan, R X Gao. Harmonic wavelet-based data filtering for enhanced machine defect identification. Journal of Sound and Vibration, 2010, 329(15): 3203-3217.
[26] D Wang, Z Peng, L Xi. The sum of weighted normalized square envelope: A unified framework for kurtosis, negative entropy, Gini index and smoothness index for machine health monitoring. Mechanical Systems and Signal Processing, 2020, 140: 106725.
[27] J Antoni, R B Randall. The spectral kurtosis: application to the vibratory surveillance and diagnostics of rotating machines. Mechanical Systems and Signal Processing, 2006, 20(2): 308-331.
[28] B Ganguly, S Chaudhuri, S Biswas, et al. Wavelet kernel-based convolutional neural network for localization of partial discharge sources within a power apparatus. IEEE Transactions on Industrial Informatics, 2020, 17(3): 1831-1841.
[29] M Lin, Ji R, Chen B, et al. Training compact CNNs for image classification using dynamic-coded filter fusion. arXiv preprint, 2021, arXiv: 2107.06916.
[30] J Chen, Y Zi, Z He, et al. Adaptive redundant multiwavelet denoising with improved neighboring coefficients for gearbox fault detection. Mechanical Systems and Signal Processing, 2013, 38(2): 549-568.
[31] E Jang, S Gu, B Poole. Categorical reparametrization with Gumble-Softmax. International Conference on Learning Representations (ICLR 2017), OpenReview. net, 2017.
[32] Y Bengio, Y Lecun, G Hinton. Deep learning for AI. Communications of the ACM, 2021, 64(7): 58-65.
[33] Y LeCun, L Bottou, Y Bengio, et al. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 1998, 86(11): 2278-2324.
[34] M Claesen, M B De. Hyperparameter search in machine learning. Proc. of the 11th Metaheuristics International Conference, 2015: 1–5.
[35] B Wang, Y Lei, N Li, et al. A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Transactions on Reliability, 2018, 69(1): 401-412.
[36] Z Zhao, T Li, J Wu, et al. Deep learning algorithms for rotating machinery intelligent diagnosis: An open source benchmark study. ISA Transactions, 2020, 107: 224-255.
[37] W Zhang, G Peng, C Li, et al. A new deep learning model for fault diagnosis with good anti-noise and domain adaptation ability on raw vibration signals. Sensors, 2017, 17(2): 425.
[38] M Ravanelli, Y Bengio. Speaker recognition from raw waveform with sincnet. 2018 IEEE Spoken Language Technology Workshop (SLT), IEEE, 2018: 1021–1028.
[39] E Bechhoefer. Condition based maintenance fault database for testing diagnostics and prognostic algorithms. MFPT Data, 2013.
Outlines

/