Gearbox Fault Identification and Classification with Convolutional Neural Networks

Abstract

Vibration signals of gearbox are sensitive to the existence of the fault. Based on vibration signals, this paper presents an implementation of deep learning algorithm convolutional neural network (CNN) used for fault identification and classification in gearboxes. Different combinations of condition patterns based on some basic fault conditions are considered. 20 test cases with different combinations of condition patterns are used, where each test case includes 12 combinations of different basic condition patterns. Vibration signals are preprocessed using statistical measures from the time domain signal such as standard deviation, skewness, and kurtosis. In the frequency domain, the spectrum obtained with FFT is divided into multiple bands, and the root mean square (RMS) value is calculated for each one so the energy maintains its shape at the spectrum peaks. The achieved accuracy indicates that the proposed approach is highly reliable and applicable in fault diagnosis of industrial reciprocating machinery. Comparing with peer algorithms, the present method exhibits the best performance in the gearbox fault diagnosis.

ZhiQiang Chen 1 and Chuan Li 1,2 and Rene-Vinicio Sanchez 3

Academic Editor:Dong Wang

1, Chongqing Engineering Laboratory for Detection, Control and Integrated System, School of Computer Science and Information Engineering, Chongqing Technology and Business University, Chongqing 400067, China
2, Research Center of System Healthy Maintenance, Chongqing Technology and Business University, Chongqing 400067, China
3, Department of Mechanical Engineering, Universidad Politecnica Salesiana, Cuenca, Ecuador

Received 11 March 2015; Revised 20 April 2015; Accepted 24 April 2015; 13 October 2015

This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

1. Introduction

Gearboxes play crucial roles in the mechanical transmission systems, are used to transmit power between shafts, and are expected to work 24 hours a day in the production system. Any failures with the gearboxes may introduce unwanted downtime, expensive repair, and even human casualties. Therefore it is essential to detect and diagnose faults in the initial stage [1-4]. As an effective component for the condition-based maintenance, the fault diagnosis has gained much attention for the safe operations of the gearboxes [5, 6].

Machine fault identification can be done with different methodologies such as vibration signature analysis, lubricant signature analysis, noise signature analysis, and temperature monitoring. The gearbox conditions can be reflected by such measurements as vibratory, acoustic, thermal, electrical, and oil-based signals [7-12]. Of the above the diagnostic by vibrations is the most employed for the reason that every machine is considered to have a normal spectrum until there is a fault, where the spectrum changes [13, 14]. The vibration signals have been proven effective to reflect the healthy condition of the rotating machinery. In the vibration-based gearbox fault diagnostics, Wang et al. [15] proposed the application of local mean decomposition of the vibration signal to diagnose a low-speed helical gearbox. Hong et al. [16] investigated the vibration measurements for the planetary gearbox fault detection. The vibration characteristics in both the time and the frequency domains were analyzed by Lei et al. [17] for the diagnostics of the planetary gearboxes.

Various studies exist, of algorithms for detection and diagnostics of faults in gearboxes; among these are support vector machines and artificial neural network. A support vector machines based envelope spectrum was proposed by Guo et al. [18] to classify three health conditions of the planetary gearboxes. An intelligent diagnosis model based on wavelet support vector machine (SVM) and immune genetic algorithm (IGA) was proposed for the gearbox fault diagnosis [19]. The IGA was developed to determine the optimal parameters for the wavelet SVM with the highest accuracy and generalization ability. Tayarani-Bathaie et al. [20] suggested a dynamic neural network to diagnose the gas turbine fault. The artificial neural network combining with empirical mode decomposition was applied for automatic bearing fault diagnosis based on vibration signals [21]. Among all the typical classifiers, the support vector classification (SVC) family (i.e., the standard SVC and its variants) attracted much attention due to their extraordinary classification performance. According to the researches, the SVM family received good results in comparison with the peer classifiers.

Recently, deep learning received great success in the classification field. The deep learning gained better classification performance owing to its "deeper" representations for the faulty features. Up to now, different deep learning networks such as deep belief network [22], deep Boltzmann machines (DBMs) [23], deep autoencoder [24], and convolutional neural networks [25] have been introduced, but few been used for the fault diagnosis cases. Tran et al. [26] introduced the application of the deep belief networks to diagnose reciprocating compressor valves. Tamilselvan and Wang [27] employed the deep belief learning based health state classification for iris dataset, wine dataset, Wisconsin breast cancer diagnosis dataset, and Escherichia coli dataset. The limited reports used the deep learning structure for the fault diagnosis, with commonly one modality feature.

This paper presents a study for the application of the convolutional neural network in the identification and classification of the gearboxes fault. Convolutional neural network (CNN) is a type of feed-forward artificial neural network. Its individual neurons are tiled in such a way that they respond to overlapping regions in the visual field [28]. CNN and its variations are widely used models for image and video recognition [29, 30]. In this work, it is used as a classifier for the gearbox faults diagnosis.

The most successful methods of vibration-based fault diagnoses are composed of two main steps: extracting the sensitive features and classifying the condition patterns. In the vibration-based fault diagnosis, the most commonly used features have been generated from the temporal [31], spectral [32], wavelet [33], and other representations of the signals. Different representations can be regarded as different observations on the vibration signals [34]. In this work, statistical measurements such as standard deviation, skewness, and kurtosis are computed from the acquired time domain data. In the frequency domain, the spectrum obtained with a FFT is divided into multiple bands. The root mean square value is calculated for each band so the energy maintains its shape at the spectrum peaks. Vectors of the features of the preprocessed signal are formed, which are used as input parameters for the CNN. It is important to point out that the testing is performed under five different rotation frequencies and for each one four different load conditions are applied, which simulates the most likely scenario within an industrial application.

The rest of this paper is structured as follows. The CNN model and method of extracting statistical features are introduced in Section 2; Section 3 explains the mechanical conditions for the experiment; Section 4 presents the implementation of classifier based on the CNN model; and Section 5 shows the obtained results and their evaluation. Finally some conclusions are drawn.

2. Methodologies

In this section, we first present the representations of the convolutional neural network. And then the approach of extracting the sensitive features is introduced, where some classical statistical parameters are calculated from the time and the frequency.

2.1. Deep Learning with Convolutional Neural Network

Convolutional neural network was inspired by the visual system's structure [35] and in particular by the models of it proposed by [36]. The first computational models are based on local connectivity between neurons and on hierarchically organized transformations of the image in Fukushima's neocognitron [37]. LeCun and collaborators, following up on this idea, designed and trained convolutional networks using the error gradient, where state-of-the-art performance was obtained [38, 39] on several pattern recognition tasks. Modern understanding of the physiology of the visual system is consistent with the processing style found in convolutional networks in the literature [40]. To this day, pattern recognition systems based on convolutional neural networks are among the best performing systems [41]. This has been shown clearly for handwritten character recognition [38], which has served as a machine learning benchmark for many years.

A typical convolutional neural network [38] is organized in layers of two types: convolutional layers and subsampling layers. Each layer has a topographic structure.

At each location of each layer, there are a number of different neurons. Each has its set of input weights that is associated with neurons in a rectangular patch in the previous layer. The same set of weights, but a different input rectangular patch, is associated with neurons at different locations.

Figure 1 presents the architecture of typical convolutional neural networks, in which the early analysis consists of alternating convolution and subsampling operations, while the last stage of the architecture consists of a generic multilayer network: the last few layers (closest to the outputs) will be fully connected 1-dimensional layers. CNNs work on the 2-dimensional data, so called maps, directly, unlike normal neural networks which would concatenate these into vectors. Typically convolutional layers are interspersed with subsampling layers to reduce computation time and to gradually build up further spatial and configural invariance. A small subsampling factor is desirable in order to maintain specificity at the same time.

Figure 1: Architecture of convolutional neural networks.

[figure omitted; refer to PDF]

Convolutional layers move forward with deriving the back propagation updates in a network, which compose feature maps by convolving kernels over feature maps in layers below them. At a convolution layer, the previous layer's feature maps are convolved with learnable kernels and put through the activation function to form the output feature map. Each output map may combine convolutions with multiple input maps. In general, it is calculated as follows [41]: [figure omitted; refer to PDF] where [figure omitted; refer to PDF] represents a selection of input feature maps; [figure omitted; refer to PDF] is the [figure omitted; refer to PDF] th layer in a network, [figure omitted; refer to PDF] is a matrix of [figure omitted; refer to PDF] ; here, [figure omitted; refer to PDF] is the size of convolutional kernels; [figure omitted; refer to PDF] is a nonlinearity active function, typically hyperbolic tangent or sigmoid function. Each output map is given an additive bias; for a particular output map, the input maps will be convolved with distinct kernels [figure omitted; refer to PDF] . That is to say, if output map [figure omitted; refer to PDF] and map [figure omitted; refer to PDF] both sum over input map [figure omitted; refer to PDF] , then the kernels applied to map [figure omitted; refer to PDF] are different for output maps [figure omitted; refer to PDF] and [figure omitted; refer to PDF] .

A subsampling layer produces downsampled versions of the input maps. If there are [figure omitted; refer to PDF] input maps, then, there will be exactly [figure omitted; refer to PDF] output maps, although the output maps will be smaller. More formally [41], [figure omitted; refer to PDF] where [figure omitted; refer to PDF] represents a subsampling function. Typically this function will sum over each distinct [figure omitted; refer to PDF] -by- [figure omitted; refer to PDF] block in the input feature map so that the output feature map is [figure omitted; refer to PDF] times smaller along both spatial dimensions. Each output map is given its own multiplicative bias [figure omitted; refer to PDF] and an additive bias [figure omitted; refer to PDF] .

To discriminate between [figure omitted; refer to PDF] classes a fully connected output layer with [figure omitted; refer to PDF] neurons is added. The output layer takes as input the concatenated feature maps of the layer below it, denoting the feature vector, [figure omitted; refer to PDF] , [figure omitted; refer to PDF] where [figure omitted; refer to PDF] is a bias vector and [figure omitted; refer to PDF] is a weight matrix.

[figure omitted; refer to PDF] , [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , and [figure omitted; refer to PDF] of the model are learnable parameters. Learning is done using gradient descent which can be implemented efficiently using a convolutional implementation of the backpropagation algorithm as shown in [41]. It should be clear that because kernels are applied over entire input maps, there are many more connections in the model than weights; that is, the weights are shared. This makes learning deep models easier, as compared to normal feedforward-backpropagation neural nets, as there are fewer parameters, and the error gradients goes to zero slower because each weight has greater influence on the final output.

2.2. Statistical Features of the Gearbox Vibration Signals

The gearbox condition can be reflected by the information included in different features in frequency and time domain. From the set of signals obtained from the measurements of the vibrations at different speeds and loads, the features in frequency and time domain are obtained. From the group of graphs the values that can be used as input parameters for the CNN are selected. Sixty percent of the samples set are used for the training of the CNN, and forty percent are used for testing.

2.2.1. Time Data Statistical Features

Usually, statistical parameters are good indices for extracting the condition information. In this research, statistical measurements such as standard deviation, skewness, and kurtosis for each node are used. Standard deviation, skewness, and kurtosis are computed from the acquired time domain data; the formulas used for this are shown in Table 1, where [figure omitted; refer to PDF] is the expected value of [figure omitted; refer to PDF] . Correction bias is used for the evaluation of skewness and kurtosis. The standard deviation, skewness, and kurtosis evaluated on each of the vibration signals are used for training and testing of the CNN. The evaluation of these is done using standard MATLAB functions.

Table 1: Formula for the evaluation of statistical values.

Feature	Definition
Mean	[figure omitted; refer to PDF]
Standard deviation	[figure omitted; refer to PDF]
Skewness	[figure omitted; refer to PDF]
Kurtosis	[figure omitted; refer to PDF]

2.2.2. Fast Fourier Transform Banded RMS Value

Figure 2 shows the vibration signal spectrum obtained during the test under the following condition patterns: gear [figure omitted; refer to PDF] with face wear 0.4 [mm], gear [figure omitted; refer to PDF] with face wear 0.5 [mm], bear [figure omitted; refer to PDF] with 2 pits on inner ring, and bear [figure omitted; refer to PDF] with 2 pits on outer ring for 5 different rotation speeds, and load at 375 W. Figure 3 shows frequency spectrum under five combinations of different condition patterns. The time domain signal was multiplied by a Hanning window to obtain the FFT spectrum, in which a shift in the frequency and an increment in the amplitude in function of the speed increment are noticeable during the test. The different spectrum graphs showed that the amplitude of each component increases in a proportional manner to the load variation. Also in the spectra some accentuations and attenuations were observed on certain spectral component, which suggests dependency of the fault features with respect to the amount of load applied.

Figure 2: Frequency spectrum in function of the speed, under the following condition patterns: 375 W load, [figure omitted; refer to PDF] with face wear 0.4 [mm], [figure omitted; refer to PDF] with face wear 0.5 [mm], [figure omitted; refer to PDF] with 2 pitting on inner ring, and [figure omitted; refer to PDF] with 2 pitting on outer ring.

[figure omitted; refer to PDF]

Figure 3: Frequency spectrum under five combinations of different condition patterns.

[figure omitted; refer to PDF]

With the objective of reducing the amount of input data to the CNN the spectrum was split in multiple bands, because with this number of bands the root mean square (RMS) values keep track of the energy in the spectrum peaks [42], where the RMS value is evaluated with (4), and [figure omitted; refer to PDF] is the number of samples of each frequency band. Consider [figure omitted; refer to PDF]

Vectors of the features of the preprocessed signal are formed as input parameters for the CNN as follows: [figure omitted; refer to PDF] RMS values, standard deviation, skewness, kurtosis, rotation frequency, and applied load measurements. In this work, the frequency range is 0 to 22050 Hz and the size of the data vector in the frequency is 18000 samples. The spectrum is divided into [figure omitted; refer to PDF] frequency bands, [figure omitted; refer to PDF] .

3. Experimental Setup

To validate the effectiveness of the proposed method, we carried out the experiments on a gearbox fault experimental platform. Figure 4 indicates the internal configuration of the gearbox and positions for accelerometers. There are 3 shafts and 4 gears composing a two-stage transmission of the gearbox. An input gear ( [figure omitted; refer to PDF] , modulus = 2, and Φ of pressure = 20) was installed on the input shaft. Two intermediate gears ( [figure omitted; refer to PDF] = [figure omitted; refer to PDF] = 53) were installed on an intermediate shaft for the transmission between the input gear and the output gear ( [figure omitted; refer to PDF] = 80, installed on the output shaft). The faulty components used in the experiments included gears [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , and [figure omitted; refer to PDF] and bearings [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , and [figure omitted; refer to PDF] as labeled in Figure 4(a). Test's conditions are described in the Table 2. The vibration signal is obtained from the measurements of a vertically allocated accelerometer in the gearbox case. Tables 3 and 4 present the description of each fault condition of each component of the gearbox used in the experiment. We call them basic condition pattern. In our experiment, a test case includes several basic condition patterns, which is a combination of multiple component faults. For example, the test case A shown in Table 5 includes the following information of faults:

: Gear [figure omitted; refer to PDF] : gear with pitting on teeth.

: Gear [figure omitted; refer to PDF] : gear with face wear 0.5 [mm].

: Bear [figure omitted; refer to PDF] : bearing with 4 pits on outer ring.

: Bear [figure omitted; refer to PDF] : bearing with 2 pits on outer ring.

: Gears [figure omitted; refer to PDF] and [figure omitted; refer to PDF] and bears [figure omitted; refer to PDF] and [figure omitted; refer to PDF] : normal.

Table 2: Test's conditions.

Characteristic ( [figure omitted; refer to PDF] )	Value
Sample frequency	44100 [Hz] (16 bits)
Sampled time	10 [s]
Power	1000 [W]
Minimum speed	700 [RPM]
Maximum speed	1600 [RPM]
Minimum load	250 [W]
Maximum load	750 [W]
Speeds	1760, 2120, 2480, 2840, 3200 [mm/s]
Loads	375, 500, 625, 750 [W]
Number of loads per test	10
Type of accelerometer	Uniaxial
Trademark	ACS
Model	ACS 3411LN
Sensibility	330 [mV/g]

Table 3: Nomenclature of gears fault.

Designator	Description
1	Normal
2	Gear with face wear 0.4 [mm]
3	Gear with face wear 0.5 [mm]
4	Gear with chafing on tooth 50%
5	Gear with chafing on tooth 100%
6	Gear with pitting on tooth depth 0.05 [mm], width 0.5 [mm], and large 0.05 [mm]
7	Gear with pitting on teeth
8	Gear with incipient fissure on 4 mm teeth to 25% of profundity and angle of 45°
9	Gear teeth breakage 20%
10	Gear teeth breakage 50%
11	Gear teeth breakage 100%

Table 4: Nomenclature of bears fault.

Designator	Description
1	Normal
2	Bearing with 2 pits on outer ring
3	Bearing with 4 pits on outer ring
4	Bearing with 2 pits on inner ring
5	Bearing with 4 pits on inner ring
6	Bearing with race on inner ring
7	Bearing with 2 pits on ball
8	Bearing with 2 pits on ball

Table 5: Condition patterns of the experiment.

Number of patterns	Basic faults
Gear faults	Bear faults
[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]
A	7	3	1	1	1	2	3	1
B	7	3	6	8	1	1	1	1
C	5	5	1	1	6	7	2	1
D	7	1	1	1	6	7	2	1
E	1	2	1	1	1	6	3	1
F	1	3	1	1	1	5	3	1
G	2	9	1	1	6	7	3	1
H	5	5	1	1	6	3	2	4
I	2	6	1	1	6	5	2	1
J	1	11	1	1	1	3	4	1
K	1	1	1	1	1	6	3	1
L	1	1	1	1	1	1	3	1

Figure 4: (a) The internal configuration of the gearbox; (b) positions for accelerometers.

(a) [figure omitted; refer to PDF]

(b) [figure omitted; refer to PDF]

To evaluate the performance of the proposed method for gearbox fault diagnosis, first, we constructed 12 condition patterns as listed in Table 5. Each pattern with 4 different load conditions and 5 different input speeds was applied during the experiments. For each pattern, load and speed condition, we repeated the tests for 5 times. In each time of the test, the vibratory signals were collected with 24 durations each of which covered 0.4096 sec.

4. Implemented Classifier Based on CNN and Statistical Features

In this section, the implementation of classifier based on CNN will be introduced. Figure 5 shows the block diagram of the process followed in the processing of the signal. The CNN-based classifier includes parameters as follows:

(1) The size of input feature map, [figure omitted; refer to PDF] , depends on the feature representation of the preprocessed signal.

(2) The number of alternating convolution and subsampling layers that decides the architecture of CNN is as follows. Two schemes are investigated: one is two convolutional layers and two subsampling layers; another is one convolutional layer and one subsampling layer.

(3) The number of output feature maps of convolution layer, [figure omitted; refer to PDF] , expresses [figure omitted; refer to PDF] th convolution layer. [figure omitted; refer to PDF] is as the number of output feature maps of [figure omitted; refer to PDF] .

(4) The scale of subsampling layer, [figure omitted; refer to PDF] , which means the size of output feature map of subsampling layer, is 1/ [figure omitted; refer to PDF] of that of the input feature map. [figure omitted; refer to PDF] expresses that of [figure omitted; refer to PDF] th subsampling layer; and [figure omitted; refer to PDF] is as the scale of layer [figure omitted; refer to PDF] .

(5) For each input map convolve with corresponding kernel and add to output map; the convolutional kernel is usually a matrix of [figure omitted; refer to PDF] , where [figure omitted; refer to PDF] is called convolutional kernel size.

Figure 5: Training and testing process block diagram.

[figure omitted; refer to PDF]

To confirm the optimal architecture of CNN-based classifier for gearbox fault diagnosis, some parameter tunings are performed. Table 6 presents 11 schemes with different parameters of the CNN-based classifier. They are applied to a test case with the 12 patterns indicated in Table 5, using data with 12000 sample signals, where sixty percent of the samples set are used for the training of the CNN, and forty percent are used for testing. The classification rate and computation time (Intel Core i7-4710MQ CPU @2.50 GHz 2.50 GHz, Memory 8.00 GB) of each epoch training are recorded in Table 6. From Table 6, we can assume that the cases of 16 × 16 input feature map are superior to those of 28 × 28. The cases with one convolutional layer and one subsampling layer are superior to those of two convolutional layers and two subsampling layers. #7~#11 cases have very good classification accuracy. #9~#11 cases have less computation times. So we select a configuration for the proposed CNN-based classifier as follows: one convolutional layer and one subsampling layer, [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , [figure omitted; refer to PDF] , and [figure omitted; refer to PDF] . The suggested architecture of the CNN-based classifier for gearbox fault diagnosis is described in Figure 6.

Table 6: Parameters tuning of the architecture of CNN.

Number	Architecture of CNN	Classification rate	Time (s/epoch)
[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]	[figure omitted; refer to PDF]
#1	[figure omitted; refer to PDF]	6	2	12	2	5	86.73%	11.6 s
#2	[figure omitted; refer to PDF]	8	2	8	2	5	88.48%	12.8 s
#3	[figure omitted; refer to PDF]	12	2	12	2	5	92.50%	21.7 s
#4	[figure omitted; refer to PDF]	8	4	-	-	5	86.71%	8.00 s
#5	[figure omitted; refer to PDF]	6	2	12	2	5	90.23%	3.90 s
#6	[figure omitted; refer to PDF]	8	2	8	2	5	89.50%	3.80 s
#7	[figure omitted; refer to PDF]	6	2	6	1	5	95.71%	2.40 s
#8	[figure omitted; refer to PDF]	6	1	6	1	5	98.77%	4.50 s
#9	[figure omitted; refer to PDF]	6	2	-	-	5	96.71%	1.04 s
#10	[figure omitted; refer to PDF]	8	2	-	-	5	98.35%	1.30 s
#11	[figure omitted; refer to PDF]	12	2	-	-	5	98.20%	2.02 s

Figure 6: Implementation of classifier based on CNN and statistical features.

[figure omitted; refer to PDF]

5. Experiment Evaluations

The training is done in first instance with the 12 patterns indicated in Table 5. The used data have 12000 sample signals, where sixty percent of the samples set are used for the training of the CNN, and forty percent are used for testing. For further tuning parameters, we consider the #9~#11 cases in Table 6 with different number of iteration epochs: 50, 100, 150, 200, 250, and 300, respectively. Table 7 indicates the classification rate for the first instance. As shown in Table 7, each parameters pair has excellent performance for the gearbox faults classification. The least classification rate is 89.46% of the pair of [figure omitted; refer to PDF] and epochs = 50; the best one is 98.35% of the pair of [figure omitted; refer to PDF] and epochs = 200. In the following experiment, [figure omitted; refer to PDF] and epochs are set to 8, 200, respectively.

Table 7: Parameters tuning of CNN.

[figure omitted; refer to PDF]	Epochs
300	250	200	150	100	50
12	97.98%	98.0%	98.02%	96.71%	95.35%	89.46%
8	97.92%	98.19%	98.35%	97.98%	96.31%	91.19%
6	97.98%	97.27%	96.71%	96.71%	96.25%	93.1%

Confusion matrix is an effective tool and is a visualization tool of the performance of a classification algorithm. Each column of the confusion matrix represents the instances in a predicted class (output class), while each row represents the instances in an actual class (target class). Figure 7 presents the confusion matrix using CNN model for 12 patterns indicated in Table 5. As shown in Figure 7, the global percentage of true positive classification of the 12 condition patterns of faults is 98.4% and the total error is 1.6%. The smallest percentage of true positive classifications is obtained for type 3; this is because this kind of conditions patterns with 6 basic faults. This is evident by observing the confusion matrix in which 30 times of type 4 are classified as type 3, noticing that mostly there is confusion between type 4 and type 3, in which they have 4 same basic faults. The percentages of true positive classification of Type 1, Type 6, and Type 12 are all 100%. Confusion matrix in Figure 7 shows that the presenting CNN model has very high percentage of true positive classification.

Figure 7: Confusion matrix using CNN.

[figure omitted; refer to PDF]

To further validate the robustness of the present CNN model, a fault condition pattern library was constructed, which has 58 kinds of combinations based on the basis patterns described in Tables 3 and 4. 20 test cases are used to test the robustness of the present CNN method; each test case has 12 kinds of combinations that are randomly selected from the pattern library. The experiment results of 20 test cases using the CNN are shown in Table 8. With regard to the CNN method, its smallest classification rate is 91.4% of 1st test case, and the largest one reaches 98.9% of 10th test case. The mean, standard deviation, and median of classification rate using CNN are 96.8%, 2.57%, and 97.7%, respectively.

Table 8: Comparisons of classification rate with SVM using 20 test cases.

Number	1	2	3	4	5	6	7	8	9	10
CNN	91.4%	98.5%	97.1%	98.0%	98.4%	98.6%	97.2%	98.8%	97.4%	98.9%
SVM	73.8%	77.4%	65.9%	67.5%	65.5%	79.2%	69.1%	81.5%	66.8%	72.0%
Number	11	12	13	14	15	16	17	18	19	20
CNN	98.5%	98.7%	94.2%	97.7%	93.5%	98.7%	97.7%	94.7%	92.7%	97.4%
SVM	72.3%	66.4%	55.9%	64.7%	63.5%	67.0%	62.1%	61.3%	64.0%	60.9%
	Mean		Std.		Least		Most		Median
CNN	96.8%		2.57%		91.4%		98.9%		97.7%
SVM	67.8%		6.49%		55.9%		81.5%		66.8%

In addition, the CNN method was compared with "shallow" learning algorithms SVM. As for the SVM, one of the most important representatives in the "shallow" learning community, good classification results can be found for the gearbox fault diagnosis, which is similar with some existing researches (e.g., [43]). The algorithm SVM is applied using the LibSVM [44]. The parameters for SVM are chosen as [figure omitted; refer to PDF] and core (kernel) given by a radial basis [figure omitted; refer to PDF] function where [figure omitted; refer to PDF] . These parameters were found through a search, aiming at the best model for the SVM. Figure 8 shows the confusion matrix using SVM method for 12 patterns indicated in Table 5. The experiment results of 20 test cases using the SVM method are shown in Table 8. Its global percentage of true positive classification of the 12 condition patterns of faults is only 69.0% and the total error is 31.0%. The smallest percentage of true positive classifications is 30% of type 3. The mean, standard deviation, and median of classification rate using SVM for the 20 test cases are 67.8%, 6.49%, and 66.8%, respectively. Comparing with the deep learning CNN method, the SVM method exhibits inferior performance for the gearbox fault diagnosis.

Figure 8: Confusion matrix using SVM.

[figure omitted; refer to PDF]

6. Conclusions

In this paper, a deep learning technique based CNN for the vibration measurements has been proposed to diagnose the fault patterns of the gearbox. The present CNN method identifies and classifies faults in gearbox by using the vibration signals measured with an accelerometer. Feature representations are selected as the input parameters of the CNN with a vector formed by RMS values, standard deviation, skewness, kurtosis, rotation frequency, and applied load. For evaluating the proposed CNN method, the gearbox fault diagnosis experiments were carried out using different techniques. The results show that the present method has the outstanding performance of the gearbox fault diagnosis, comparing with peer methods. This type of classifiers could make a contribution to maintenance routines for industrial systems, towards lowering costs and guarantying a continuous production system, and, with the appropriate equipment, online diagnostics could be performed.

Acknowledgments

This work is supported by Natural Science Foundation Project of CQ CSTC (nos. cstc2012jjA40041 and cstc2012jjA40059), Science Research Fund of Chongqing Technology and Business University (no. 2011-56-05), the National Natural Science Foundation of China (51375517), and the Project of Chongqing Innovation Team in University (KJTD201313).

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

References

[1] Y. Lei, M. J. Zuo, Z. He, Y. Zi, "A multidimensional hybrid intelligent method for gear fault diagnosis," Expert Systems with Applications , vol. 37, no. 2, pp. 1419-1430, 2010.

[2] Z. Yang, W. I. Hoi, J. Zhong, "Gearbox fault diagnosis based on artificial neural network and genetic algorithms," in Proceedings of the International Conference on System Science and Engineering (ICSSE '11), pp. 37-42, IEEE, Macao, China, June 2011.

[3] A. Aherwar, M. S. Khalid, "Vibration analysis techniques for gearbox diagnostic: a review," International Journal of Advanced Engineering Technology , vol. 3, no. 2, 2012.

[4] D. Wang, P. W. Tse, K. L. Tsui, "An enhanced Kurtogram method for fault diagnosis of rolling element bearings," Mechanical Systems and Signal Processing , vol. 35, no. 1-2, pp. 176-199, 2013.

[5] D. Wang, P. W. Tse, W. Guo, Q. Miao, "Support vector data description for fusion of multiple health indicators for enhancing gearbox fault diagnosis and prognosis," Measurement Science and Technology , vol. 22, no. 2, 2011.

[6] C. Li, M. Liang, "Separation of the vibration-induced signal of oil debris for vibration monitoring," Smart Materials & Structures , vol. 20, no. 4, 2011.

[7] S. Hou, M. Liang, Y. Zhang, C. Li, "Vibration signal demodulation and bearing fault detection: a clustering-based segmentation method," IMeche Proceedings Part C: Journal of Mechanical Engineering Science , vol. 228, no. 11, pp. 1888-1899, 2014.

[8] D. Wang, Q. Miao, R. Kang, "Robust health evaluation of gearbox subject to tooth failure with wavelet decomposition," Journal of Sound and Vibration , vol. 324, no. 3-5, pp. 1141-1157, 2009.

[9] T. Toutountzakis, C. K. Tan, D. Mba, "Application of acoustic emission to seeded gear fault detection," NDT & E International , vol. 38, no. 1, pp. 27-36, 2005.

[10] J. R. Ottewill, M. Orkisz, "Condition monitoring of gearboxes using synchronously averaged electric motor signals," Mechanical Systems and Signal Processing , vol. 38, no. 2, pp. 482-498, 2013.

[11] A. M. D. Younus, B.-S. Yang, "Intelligent fault diagnosis of rotating machinery using infrared thermal image," Expert Systems with Applications , vol. 39, no. 2, pp. 2082-2091, 2012.

[12] C. Li, M. Liang, "Extraction of oil debris signature using integral enhanced empirical mode decomposition and correlated reconstruction," Measurement Science and Technology , vol. 22, no. 8, 2011.

[13] P. Jayaswal, A. K. Wadhwani, K. B. Mulchandani, "Machine fault signature analysis," International Journal of Rotating Machinery , vol. 2008, 2008.

[14] A. K. S. Jardine, D. Lin, D. Banjevic, "A review on machinery diagnostics and prognostics implementing condition-based maintenance," Mechanical Systems and Signal Processing , vol. 20, no. 7, pp. 1483-1510, 2006.

[15] Y. Wang, Z. He, J. Xiang, Y. Zi, "Application of local mean decomposition to the surveillance and diagnostics of low-speed helical gearbox," Mechanism and Machine Theory , vol. 47, no. 1, pp. 62-73, 2012.

[16] L. Hong, J. S. Dhupia, S. Sheng, "An explanation of frequency features enabling detection of faults in equally-spaced planetary gearbox," Mechanism and Machine Theory , vol. 73, pp. 169-183, 2014.

[17] Y. Lei, D. Kong, J. Lin, M. J. Zuo, "Fault detection of planetary gearboxes using new diagnostic parameters," Measurement Science and Technology , vol. 23, no. 5, 2012.

[18] L. Guo, J. Chen, X. Li, "Rolling bearing fault classification based on envelope spectrum and support vector machine," Journal of Vibration and Control , vol. 15, no. 9, pp. 1349-1363, 2009.

[19] F. Chen, B. Tang, R. Chen, "A novel fault diagnosis model for gearbox based on wavelet support vector machine with immune genetic algorithm," Measurement , vol. 46, no. 1, pp. 220-232, 2013.

[20] S. S. Tayarani-Bathaie, Z. N. Sadough Vanini, K. Khorasani, "Dynamic neural network-based fault diagnosis of gas turbine engines," Neurocomputing , vol. 125, pp. 153-165, 2014.

[21] J. B. Ali, N. Fnaiech, L. Saidi, B. Chebel-Morello, F. Fnaiech, "Application of empirical mode decomposition and artificial neural network for automatic bearing fault diagnosis based on vibration signals," Applied Acoustics , vol. 89, pp. 16-27, 2015.

[22] N.-N. Ji, J.-S. Zhang, C.-X. Zhang, "A sparse-response deep belief network based on rate distortion theory," Pattern Recognition , vol. 47, no. 9, pp. 3179-3191, 2014.

[23] B. Leng, X. Zhang, M. Yao, Z. Xiong, "A 3D model recognition mechanism based on deep Boltzmann machines," Neurocomputing , vol. 151, pp. 593-602, 2015.

[24] K. Katayama, M. Ando, T. Horiguchi, "Model of MT and MST areas using an autoencoder," Physica A: Statistical Mechanics and Its Applications , vol. 322, pp. 531-545, 2003.

[25] T. N. Sainath, B. Kingsbury, G. Saon, H. Soltau, A. Mohamed, G. Dahl, B. Ramabhadran, "Deep convolutional neural networks for multi-modality isointense infant brain image segmentation," NeuroImage , vol. 108, pp. 214-224, 2015.

[26] V. T. Tran, F. Althobiani, A. Ball, "An approach to fault diagnosis of reciprocating compressor valves using Teager-Kaiser energy operator and deep belief networks," Expert Systems with Applications , vol. 41, no. 9, pp. 4113-4122, 2014.

[27] P. Tamilselvan, P. Wang, "Failure diagnosis using deep belief learning based health state classification," Reliability Engineering and System Safety , vol. 115, pp. 124-135, 2013.

[28] DeepLearning 0.1. LISA Lab, "Convolutional Neural Networks (LeNet)-DeepLearning 0.1 documentation," August 2013

[29] M. Matsugu, K. Mori, Y. Mitari, Y. Kaneda, "Subject independent facial expression recognition with robust face detection using a convolutional neural network," Neural Networks , vol. 16, no. 5-6, pp. 555-559, 2003.

[30] Y. LeCun, "LeNet-5, convolutional neural networks," November 2013

[31] M. Amarnath, I. R. P. Krishna, "Local fault detection in helical gears via vibration and acoustic signals using EMD based statistical parameter analysis," Measurement , vol. 58, pp. 154-164, 2014.

[32] K. K. McKee, G. L. Forbes, I. Mazhar, R. Entwistle, M. Hodkiewicz, I. Howard, "A vibration cavitation sensitivity parameter based on spectral and statistical methods," Expert Systems with Applications , vol. 42, no. 1, pp. 67-78, 2015.

[33] R. Yan, R. X. Gao, X. Chen, "Wavelets for fault diagnosis of rotary machines: a review with applications," Signal Processing , vol. 96, pp. 1-15, 2014.

[34] C. Lim, M. Liang, T. Wang, "Criterion fusion for spectral segmentation and its application to optimal demodulation of bearing vibration signals," Mechanical Systems and Signal Processing , 2015.

[35] Y. Bengio, "Learning deep architectures for AI," Foundations and Trends in Machine Learning , vol. 2, no. 1, pp. 1-27, 2009.

[36] D. H. Hubel, T. N. Wiesel, "Receptive fields, binocular interaction, and functional architecture in the cat's visual cortex," The Journal of Physiology , vol. 160, pp. 106-154, 1962.

[37] K. Fukushima, "Neocognitron: a self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position," Biological Cybernetics , vol. 36, no. 4, pp. 193-202, 1980.

[38] Y. LeCun, L. Bottou, Y. Bengio, P. Haffner, "Gradient-based learning applied to document recognition," Proceedings of the IEEE , vol. 86, no. 11, pp. 2278-2323, 1998.

[39] Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, L. D. Jackel, "Backpropagation applied to handwritten zip code recognition," Neural Computation , vol. 1, no. 4, pp. 541-551, 1989.

[40] T. Serre, G. Kreiman, M. Kouh, C. Cadieu, U. Knoblich, T. Poggio, "A quantitative theory of immediate visual recognition," Computational Neuroscience: Theoretical Insights into Brain Function , vol. 165, of Progress in Brain Research, pp. 33-56, Elsevier, 2007.

[41] J. Bouvrie, "Notes on convolutional neural networks,", MIT, 2006.

[42] I. A. Abu-Mahfouz, "A comparative study of three artificial neural networks for the detection and classification of gear faults," International Journal of General Systems , vol. 34, no. 3, pp. 261-277, 2005.

[43] D. L. de Souza, M. H. Granzotto, G. M. de Almeida, L. C. Oliveira-Lopes, "Fault detection and diagnosis using support vector machines-a SVC and SVR comparison," Journal of Safety Engineering , vol. 3, no. 1, pp. 18-29, 2014.

[44] C.-C. Chang, C.-J. Lin, "LIBSVM: a Library for support vector machines," ACM Transactions on Intelligent Systems and Technology , vol. 2, no. 3, article 27, 2011.