Optimizing SVM’s parameters based on backtracking search optimization algorithm for gear fault diagnosis
Vantrong Thai^{1} , Junsheng Cheng^{2} , Viethung Nguyen^{3} , Phuonganh Daothi^{4}
^{1, 2, 3}State Key Laboratory of Advanced Design and Manufacturing for Vehicle Body, Hunan University, Changsha, China
^{1, 3}Faculty of Mechanical Engineering, Hanoi University of Industry, Hanoi, Vietnam
^{4}Faculty of Information Technology, University Economic and Technical Industries, Hanoi, Vietnam
^{1}Corresponding author
Journal of Vibroengineering, Vol. 21, Issue 1, 2019, p. 6681.
https://doi.org/10.21595/jve.2018.19859
Received 2 April 2018; received in revised form 29 July 2018; accepted 5 August 2018; published 15 February 2019
JVE Conferences
The accuracy of a support vector machine (SVM) classifier is decided by the selection of optimal parameters for the SVM. The Backtracking Search Optimization Algorithm (BSA) is often applied to resolve the global optimization problem and adapted to optimize SVM parameters. In this research, a SVM parameter optimization method based on BSA (BSASVM) is proposed, and the BSASVM is applied to diagnose gear faults. Firstly, a gear vibration signal can be decomposed into several intrinsic scale components (ISCs) by means of the Local CharacteristicsScale Decomposition (LCD). Secondly, the MPE can extract the fault feature vectors from the first few ISCs. Thirdly, the fault feature vectors are taken as the input vectors of the BSASVM classifier. The analysis results of BSASVM classifier show that this method has higher accuracy than GA (Genetic Algorithm) or PSO (Particles Swarm Algorithm) algorithms combined with SVM. In short, the BSASVM based on the MPELCD is suitable to diagnose the state of health gear.
Keywords: signal processing, fault detection, gears, artificial neural networks, backtracking search optimization algorithm.
1. Introduction
The gearbox is the most crucial transmission mechanism in a rotating machine, and the implementation of online monitoring and diagnosis has become quite urgent and necessary. The vibration signal of a gearbox contains much noise and unstable factors thus the vibration signal is a typical nonstationary signal. The fault signal characteristic is very weak and is usually masked by noise, especially when the fault is in its early stages; thus, it is very difficult for getting the fault features [1]. There are three steps in diagnosing fault gears, namely: characteristic signal detection, feature extraction and fault classification. Generally, the process of extracting the features of faults is divided into selection and extraction. In both theoretical and experimental fields, the fact of selection and extraction of fault features is the common principle in diagnosing faults. Feature extraction is an important step in the fault identification. In case of incorrect or incomplete feature extraction, it unavoidably leads to the fact that the classification and false diagnosis are made with errors [2]. So, the extraction of the effective information about the fault characteristics from complex dynamic mechanical signals is the key factor to solve the problem of largescale complex mechanical and electrical equipment fault diagnosis.
The corresponding characteristics of the vibration signals will be presented, and getting the extraction of the fault information of a nonstationary vibration signal is the crux of gear fault diagnosis. Vibration signals are usually processed by decomposing the original signal, such as fast Fourier transform, wavelet transform, HilbertHuang transform and EMD method [3]. This is one of the efficient techniques in diagnosing faults based on of timefrequency resolution, i.e. EMD is rather good at extracting the Intrinsic Mode Functions (IMFs), or monocomponent functions embracing the original signal [4]. But the EMD method has several shortcomings, such as the problem of mode mixing, distorted components and timeconsuming decomposition [5]. To this end, Wu and Huang have proposed a method namely EEMD [6]. Pattern recognition is another side in diagnosing gear faults.
Recently, Cheng et al. have developed a new novel signal decomposition approach named as the local characteristic scale decomposition (LCD). Similar to the EMD, the LCD method is used to decompose a complex signal into several ISCs and a residue [7]. Because the LCD is the same EMD method, it is a kind of datadriven and adaptive nonstationary signal decomposition, so it is suitable for processing nonstationary signals such as vibration signals of gears.
Support vector machine (SVM) proposed by Vapnik et al. is a promising classification method and has been successfully applied to many engineering fields, such as face recognition, credit scoring and mechanical fault diagnosis, etc. [8]. SVM has the high generalization ability that depends on the adequate setting of parameters such as penalty coefficient $C$ and kernel parameters $\sigma $. Therefore, the selection optimal parameters are essential and important to obtain a good performance in handling learning task of SVM [9]. In the past several years, the optimal SVM has gained great attentions. There are several methods for setting the parameters of SVM such as the grid search, the crossvalidation method, and the gradient descent method [10]. These methods have several drawbacks; for example, the performance of grid search is sensitive to the setting of the grid range and coarseness for each parameter, which is not easy to be set without prior knowledge, and the crossvalidation method requires long and complicated calculations.
The Backtracking Search Algorithm (BSA), which has been developed by Civicioglu, is an evolutionary algorithm (EA) to solve problems of realvalued numerical optimization. Selection, mutation and crossover are three wellknown operators which are based on the BSA method but others like the genetic algorithm (GA) and differential evolution (DE) [11]. Furthermore, unlike many other metaheuristics, the BSA algorithm has only one control parameter and is not very sensitive to the initial value as reported therein. Since it had been introduced, the BSA attracted many researches, and it was applied to various optimization problems. Some successful examples are described below. In [12], a comparative analysis of BSA with other evolutionary algorithms for global continuous optimization was given. In [13], the BSA was used for the antenna array design. In [14], the BSA was employed for the design of robust Power System Stabilizers (PSSs) in multi machine power systems. In [15], it was used for the allocation of multitype distributed generators along distribution networks [16]. The problems of realvalued numerical optimization were quickly resolved by the BSA method, and the experiments demonstrated better results than EAs. Because of applying only one control parameter, thereby, researchers got more advantages in conducting experiments. For analyzed positive point, the paper will apply BSA in the combination with the SVM aiming at diagnosing faults gears, socalled BSASVM.
In this paper, the MPELCD based on BSASVM is used to diagnose and classify gear faults. Firstly, the original vibration signal is decomposed by the LCD method into some ISC components. Then, the first few ISCs are chosen and extracted the fault feature vectors by the MPE algorithm [17]. Thirdly, in order to identify the work condition of gear, in this paper, the SVM is served as a classifier [18]. Furthermore, the authors proposed a new optimal algorithm named as BSA to make the optimization for the SVM parameters (BSASVM). The characteristic vectors of the stationary ISCs are taken as the input data of the BSASVM, and then the gear faults and the normal gear condition can be differentiated [7]. Furthermore, to ascertain the superiority of the MPELCD based on BSASVM, it is compared with EMD and EEMD combined with GASVM, PSOSVM and SVM. The analysis results show that the diagnosis approach of BSASVM assisted with MPELCD is suitable for processing nonstationary signals, such as vibration signals of gears, with a higher accuracy and effect when compared to other methods.
The content of the paper composes as: Section 2 and 3 are dedicated to the LCD and MPE methods. In Section 4, the parameter optimization algorithm based on the BSA method is addressed. Section 5 refers to characteristic energy extracted from a number of ISCs which played as input vectors of BSASVM. The most important content will be shown in Section 6. This not only introduces the optimization algorithm linked to BSOASVM and LCD but indicates its strong points in practice. Eventually, Section 7 will make some conclusions.
2. Local characteristicsscale decomposition method
Similar to EMD, the LCD is a selfadaptive data decomposition method. Based on the local characteristic scale, the LCD establishes a new definition of a monocomponent with physical meaning [19]. Any complex signal $x\left(t\right)$ can be decomposed into several ISCs and the residue by using the LCD [18], as follows:
where ${c}_{i}\left(t\right)$ is the $i$th ISC and ${r}_{n}\left(t\right)$ is the residue. The assessment criterion for ISC is as follows: all the maxima are positively, and all the minima are negatively in the whole data set. As shown in Fig. 1, any two adjacent maxima (minima), (${t}_{k1}$, ${x}_{k1}$) and $({t}_{k+1},{x}_{k+1})$ are connected by a straight line. To the intermediate minima (maxima) (${t}_{k}$, ${x}_{k}$), its corresponding point (${t}_{k}$, ${A}_{k}$) on this straight line is as follows:
For assuring the smooth and symmetric features of the ISC, the proportions of ${x}_{k}$ and ${A}_{k}$ remain constant, as follows:
where $a$ is a proportional coefficient. When $a$ is a constant, the proportions of ${x}_{k}$ and ${A}_{k}$ can remain constant. Generally, $a$ is set as 0.5, thus, ${A}_{k}/{x}_{k}=$ –1. At this time, ${x}_{k}$ and ${A}_{k}$ are symmetrical for the $x$axis ensuring the symmetric feature of the achieved ISC.
Without losing the generality, the signal is shown as:
where:
${x}_{2}\left(t\right)=4\mathrm{sin}\left(40\pi t\right),t=0:1/1000:2.$
In Fig. 1 the waveforms of $x\left(t\right)$, ${x}_{1}\left(t\right)$ and ${x}_{2}\left(t\right)$ are shown.
As a constant sequence or monotonic sequence, ${r}_{n}\left(t\right)$ represents the average trend of the signal generally. The ISC component ${c}_{i}\left(i=1,\dots ,n\right)$ represents a signal of different frequencies from high to low. The signal frequency component in each frequency band changes according to the original signal. The decomposition process of the LCD is as follows (the whole decomposition process ends when the SD criterion [17] is satisfied, and a value of SD = 0:3 was set in this study):
(1) Assume the number of extrema of the signal $x\left(t\right)$ is $M$, and determine all the extrema (${t}_{k}$, ${x}_{k}$) ($k=1,\dots ,M$) of the signal $x\left(t\right)$.
(2) Compute ${A}_{k}$($k=1,\dots ,M$) according to Eq. (2), and calculate the corresponding ${L}_{k}$ ($k=1,\dots ,M$) according to Eq. (3):
where $a=$ 0.5. When calculating ${A}_{1}$, (${t}_{0}$, ${x}_{0}$) needs to be extended by the image method [18]. Similarly, ${A}_{M}$ can be calculated after (${t}_{M+1}$, ${x}_{M+1}$) is extended [20].
Fig. 1. Waveform of signal: a) $x\left(t\right)$, b) ${x}_{1}\left(t\right)$, c) ${x}_{2}\left(t\right)$
a)
b)
c)
Fig. 2. Result of signal (10) decomposed by EMD
a)
b)
c)
Fig. 3. Result of signal decomposed by LCD
a)
b)
c)
(3) All the ${L}_{k}\left(k=1,\dots ,M\right)$ are connected by a spline line $S{L}_{1}\left(t\right)$, which is defined as the base line of the LCD. By contrast, EMD's base line is defined as the mean of the upper and the lower envelopes.
(4) The difference between the data and the base line $S{L}_{1}\left(t\right)$ is the first component ${h}_{1}\left(t\right)$:
If ${h}_{1}\left(t\right)$ is an ISC, take it as the first ISC of $x\left(t\right)$. Otherwise, take it as the original signal and repeat the above process until ${h}_{m}\left(t\right)$ is an ISC after $m$ iterations of the computation. Afterwards, ${h}_{m}\left(t\right)$ is expressed as the $IS{C}_{1}$.
(5) Separate the first $IS{C}_{1}$ from $x\left(t\right)$:
(6) Take the residue ${r}_{1}$ as the original signal to be processed. Repeat the above process until $IS{C}_{1},\dots ,IS{C}_{n}$ and the residues are obtained, as shown in Eq. (1).
The original signal is disintegrated into several ISCs by applying LCD, and the first few ISCs have the highest frequency and largest energy, while the last few ISCs remain relatively moderate. However, high frequency modulations still exist, which can interfere with the feature extraction. The TEO is used to demodulate the obtained ISC signal in this paper.
3. Permutation entropy (PE) and multiscale permutation entropy (MPE)
3.1. Permutation entropy
Bandt and Pompe suggested the Permutation entropy (PE) in order to get the detection of the dynamic change in the time series by making a comparison between the neighboring values. The concept and steps to calculate PE values are described as follows [14]:
A time series given with the length $N\left\{x\left(k\right),k=\mathrm{1,2},\dots ,N\right\}$, then the $m$ dimensional vector at time $i$ can be constructed as:
where ${X}_{i}^{m}$ is a new time series, $m$ represents the embedding dimension, and $\tau $ is time delay. As described in [17], the ${X}_{i}^{m}$ has a permutation ${\pi}_{{r}_{0},{r}_{1},...,{r}_{m1}}$; if it satisfies that:
where $0\le {r}_{i}\le m1$ and ${r}_{i}\ne {r}_{j}$. Therefore, for an $m$tuple vector, there are $m!$ possible distributions. Furthermore, we define the relative frequency for each distribution as:
where $Num\left\{{X}_{i}^{m}\right\}$ represents the number of ${X}_{i}^{m}$ which is consistent with the type $\pi $. The definition of PE with m dimension can be written as:
Note that ${H}_{PE}$ attains the maximum value $ln(m!)$ when ${P}_{i}=1/m!$ Then the normalized permutation entropy by $\mathrm{l}\mathrm{n}(m!)$ could be formulated as:
It can be known that ${H}_{NPE}\left(m\right)$ satisfies that $0\le {H}_{NPE}\left(m\right)\le 1)$.
It would be concluded that a bigger ${H}_{NPE}$ value shows the time series is more random and irregular. In case of a smaller ${H}_{NPE}$ value, it can be deduced that the time series is more regular and periodic. In extreme cases, the time series is a white noise, the ${H}_{NPE}$ value is one, also in the case of predicted signal (sine or cosine), the ${H}_{NPE}$ value is zero. Therefore, PE may be utilized to make the estimation for the complexity as well as a dynamic change for a given signal.
3.2. Multiscale permutation entropy
Costa [23] developed the multiscale analysis algorithm to estimate the complexity of the original time series based on alternative scales. Aziz and Aric proposed the multiscale permutation entropy (MPE) on the basis of multiscale analysis definition. The MPE algorithm embraces two steps: firstly, getting multiple scale time series from the original time ones used the coarsegrained procedure, secondly, the determination of permutation entropy value for every coarsegrained time series [19]. This process is summed up as:
(1) A time series is given as $x\left(k\right)$, $k=\mathrm{1,2},\dots ,N$. Splitting into disjointed windows is different in terms of length $s$. The coarsegrained time series $ysj$ at a scale factor $s$ in which $s$ means a positive integer that may be constructed in accordance in Eq. (12):
(2) In the MPE analysis, the PE of each coarsegrained time series is calculated based on Eqs. (7)(11) and then plotted as the function of the scale factors, which can be expressed as:
We calculated the PE of each coarsegrained time series as a function of scale factor $t$ and then plotted it as a function of the scale factor, and call this procedure as the multiscale permutation entropy. In order to select the best $m$ for MPE calculation, we take the Gaussian white noise signal with length $N=$ 2048 as an example. The MPEs are calculated under embedding dimension $m=$ 4, 5, 6, and 7 when the parameters maximal scale factor ${t}_{max}=$ 12 and $\tau =$ 1 [7].
4. BSA and parameter optimization of SVM based on BSA
4.1. Backtracking search optimization algorithm
The main content of BSA method is to generate a trial population including two new crossover and mutation operators. The BSA strategy is considered as powerful exploration because this method both generates trial populations and controls the amplitude of the searchdirection matrix and searchspace boundaries [21]. Particularly, the BSA stores a population from a randomly chosen previous generation to use it in generating the searchdirection matrix. The BSA strategy is very strong in terms of both a global exploration and local exploitation with a good feature of local minima avoidance [22, 23]. The main five procedures of the BSA method are presented as follows in Fig. 5.
Problem and Algorithm Parameter: An overview of five processes is provided as follows.
Fig. 4. Flow chart of backtracking search optimization algorithm
4.1.1. Initialization
The procedures of BSA begin from initializing the population $P$ as follows:
In which: NP is the size of population (Pop Size). DP is the dimensional number of the problem. random is a real value which is uniformly allocated between 0 and 1. $lowe{r}_{j}$ stands for the lower bound for the $j$th factor of the $i$th individual. $uppe{r}_{j}$ is the upper bound for the $j$th factor of the $i$th individual.
4.1.2. SelectionI
The generation of $oldP$ is the historical population, in the procedure of the SelectionI, and it is used to make a calculation for the search direction. The formulation is as follows:
In each iteration, $oldP$ is defined as follows:
In which: $\u2254$ means the updated operation. Two random numbers, $a$ and $b$ , are within the range [0, 1]. The above equation assures that the BSA algorithm population might be randomly chosen from a historical population. The algorithm memorizes the historical population till it is changed via a random permutation.
4.1.3. Mutation
Initially, the trial population is created via mutation operation as per the bellow formulation:
where $F$ is a scale factor which controls the amplitude of mutation ( $oldPP$ ).
In this paper, $F=3\u2022random$ , where $random$ is a random real number with uniform distribution within the range (0, 1). By involving the historical population in calculating $oldPP$ , BSA learns from its memory of previous generations to obtain a trial population [24].
4.1.4. Crossover
The final trial population $T$ is generated by crossover. The guidance of the trial individuals characterized by improved fitness values supports the search direction in optimizing the problem. BSA crossover works as the following procedure. A binary integervalued matrix (map) of size $NP\times DP$ is computed in the first step.
The individuals of $T$ are generated by utilizing relevant individuals of $P$ . If ${map}_{i,j}=$ 1, $T$ is updated with ${T}_{i,j}:={P}_{i,j}{P}_{i,j}$ .
4.1.5. SelectionII
In the stage of SelectionII, ${T}_{i}$ makes the corresponding ${P}_{i}$ better in the manner of fitness value which is utilized for updating ${P}_{i}$ [21]. As the BSA finds the best optimal value ( ${P}_{best}$ ) which is dominant comparing to all previous ones, ${P}_{best}$ takes the place of all optimal solutions, and these values are updated as the most fitting value of ${P}_{best}$ .
4.2. SVM parameter optimization based on BSA
4.2.1. Support vector machine (SVM)
The SVM is a type of machine learning technique. The SVM relies on the theory of statistical learning. The SVM is handling the training samples as the input to a higherdimensional characteristic space through the use of a mapping function ${\varphi}^{7}$ . Assuming that there is a given set of the training samples $G=\left\{\left({x}_{i},{y}_{i}\right),i=\mathrm{1,2},...,l\right\}$ in which each sample ${x}_{i}\in {R}^{d}$ belongs to a class by $y\in \left\{+1,1\right\}$ , and the training data is not linearly separable in the space of feature, then the target function can be expressed as follows [17]:
${\xi}_{i}\ge 0,i=\left\{\mathrm{1,2},\dots ,l\right\}.$
In which $\omega $ is the normal vector of the hyperplane, $C$ is the penalty parameter, $b$ is the bias, ${\xi}_{i}$_{}is nonnegative slack variables, and $\varphi \left(x\right)$ is the mapping function.
By introducing a set of Lagrange multipliers ${\alpha}_{i}\ge $ 0, the optimization problem could be rewritten as:
$0\le {\alpha}_{i}\le C,{\sum}_{i=1}^{l}{\alpha}_{i}{y}_{i}=0.$
The function of making decision can be achieved as:
The SVM method used the radial basis kernel function which is the most common kernel function as it indicates in the bellow equation:
where $\sigma $ is the kernel parameter.
4.2.2. SVM’s parameter optimization relied on BSA
The performance of SVM is significantly impacted by its parameters. It needs to be selected as a penalty factor $C$ and kernel parameter $\sigma $ in the function of Gaussian kernel. It is not easy to select these parameters. As a whole, $C$ and $\sigma $ are chosen empirically. Therefore, this paper applied the BSA as a technique for optimizing the parameters of SVM. As a consequence, $C$ and $\sigma $ played as the variables. SVM error testing became the fitness function for the sake of optimization.
The SVM error testing is made as:
where $x=\left(C;\sigma \right)$ and the test error of SVM was defined as:
where ${y}_{t}$ and ${y}_{f}$ mean the numbers of true and false classified samples, respectively. The desirable value is too small to ensure high classification accuracy.
4.2.3. Experimental results
The paper used Thyroid, Seed and Escherichia coli (E. Coli) as three common sets of benchmark data provided by the University of California, Irvine to quantify the performance of the suggested BSASVM method.
Table 1 showed the training and test sets. Every sampling set is separated into two subsets. In which, one subset is used for SVM training, and the other is for testing the obtained model. The training set accounted for 70 %, and the test set took 30 % of the total samples. Based on the trial and error detection practice, this proportion was selected in order to evaluate the performance of the achieved SVM which was optimal for the available samples.
Three data sets were used to make classification among the BSASVM, GASVM, PSOSVM, and CMAESSVM methods. The values selection is the same in all four above methods in order to make comparison fairly (e.g., iteration = 30 and Pop Size = 30). For the PSO, the parameters were fixed with the values given in the literature [22, 26] (i.e., $W=$ 0:9, ${c}_{1}=$ 0:5, and ${c}_{2}=$ 1:25). For CMAES, the parameters were fixed with the values given in the literature [24] (i.e., ${\sigma}_{0}=$ 0:25 and $\mu =4+3\mathrm{l}\mathrm{o}\mathrm{g}\left(N\right)$ ). Each testing method result was considered as the average value of 30 runs. The training data and test data were both mixed and were randomly divided, as shown in Table 1.
Lin et al. argued that [25] the lower and upper bounds of $C$ were given in [0:01; 35000] and $\sigma $ in [0:01; 32] for the BSASVM, GASVM, PSOSVM, and CMAESSVM classifiers. Each search method gave the values of $C$ and $\sigma $ in order to give the smallest value of the classification error. Table 2 presented experimental results.
The effectiveness of the proposed method was illustrated in Tables from 2 to 4 on the basis of the detailed classification results of each data set. The Thyroid and Seed data sets encompassed three classes, thus, the authors needed two SVM classifiers. The E. Coli data set embraced five classes; therefore, the authors needed four classifiers. These tables show the optimal parameters ( $C$ and $\sigma $ ), average test error, and average cost time done by different algorithms.
Fig. 5. Parameter optimization flowchart of SVM based on BSA
Table 1. Parameters of datasets
Name

Data

Train

Test

Validation data

Input

Class

Thyroid

215

151

52

150

5

3

Seed

210

147

55

160

7

3

E. coli

327

229

60

180

7

5

Table 2. Results of thyroid data set
Method

Training samples

Test samples

Average cost time (s)

Average test errors (%)

Refs.

BSASVM

150

52

15.83

0.000

[25]

PSOSVM

150

52

36.31

2.358

[26]

GASVM

150

52

31.12

1.442

[27]

CMAESSVM

150

52

32.56

2.622

[28]

Table 3. Results of seed data set
Method

Training samples

Test samples

Average cost time (s)

Average test errors (%)

Refs.

BSASVM

160

55

17.65

0.910

[25]

PSOSVM

160

55

40.69

3.993

[26]

GASVM

160

55

36.38

3.552

[27]

CMAESSVM

160

55

37.56

2.298

[28]

The results of the E. Coli, Seed and Thyroid classification were given in Table 1. The next Table indicates that the cost timing and testing error of BSASVM was a bit lower in comparison with those of other methods as GASVM, PSOSVM, and CMAESSVM. Civicioglu said that the BSA utilized a mutation mechanism in which there was a complex crossover and one individual [25]. Moreover, by using its memory, the BSA took an advantage of the experiences achieved from previous generations. Tables 24 demonstrate that the BSASVM classifier achieved higher classification accuracy in the way of a shorter time as comparing to other methods. Next, the BSASVM method was used to diagnose a gear fault.
Table 4. Results of E. Coli data set
Method

Training samples

Test samples

Average cost time (s)

Average test errors (%)

Refs.

BSASVM

180

60

26.73

4.641

[25]

PSOSVM

180

60

59.43

5.364

[26]

GASVM

180

60

44.78

7.787

[27]

CMAESSVM

180

60

42.52

8.582

[28]

5. Gear fault diagnosis method based on BSASVM and LCDMPE
Sections 2 and 3 showed the applied LCD in the combination with the MPE under different work status to analyze a gear vibration signal. Thereby, fault patterns are clearly recognized via the energy of each ISC changed when the gear malfunctioned. The BSASVM input vector is the energy feature of every ISC component. By doing so, the work status and fault patterns of the gear can be identified.
Fig. 6. Flowchart chart of gear fault diagnosis based on LCDMPE and BSASVM
Fig. 6 shows the flow chart of the LCDMPE and BSASVM method for the gear fault diagnosis. The description of the method for diagnosing gear faults is as follows:
(1) Choose several signals as samples under three cases: gear normal, gear chipped, and gear broken.
(2) Disintegrate the original vibration signals by the LCD method into several ISCs. The first mISCs which include the most dominantly information of the fault gear will be chosen to extract the feature.
(3) Calculate MPE for each gear vibration signal getting from the first $m$ ISCs with the parameter selection: $m=$ 6; $\tau =$ 1; $N=$ 2048, and the maximum scale factor ${t}_{max}=$ 12.
(4) Then the MPEs are obtained in all scales, and are viewed as the feature vector $E$ to represent the main fault information of gear vibration signal.
(5) Run the BSASVM, with the parameters of SVM, named as $N$ and $\sigma $, which are optimized by the BSA.
(6) Input the vector $E$ into the BSASVM classifier and realize training. The fitness function is given by Eq. (21). The net results of $N$ and are input to the BSASVM classifier.
(7) The output of BSASVM is defined with the work conditions of the gear with three classes: class 1 – normal [–1 –1 +1]; class 2 – chipped tooth [–1 +1 –1]; class 3 – broken tooth [+1 –1 –1].
6. Application of BSASVM and LCDMPE to diagnose gear faults
Data collected in this paper comes from the public data sets distributed by the Prognostics and Health Management (PHM) Society [29], and the data sets were sampled synchronously from two accelerometers mounted on each side of the gearbox housing shown in Fig. 7. Data collection was implemented at five different shaft speeds of 30, 35, 40, 45 and 50 Hz under a low and high load from the brake with the sample frequency $fs=$ 200/3 kHz. The low and high loads have resulted in a small difference of shaft speed, each load case is repeated four times. There are totally 560 different cases to be diagnosed, with six cases using helical gears and the other eight spur gears. On the input shaft, the tachometer generates 10 pulses per revolution and data from the tachometer is very accurate. Here we chose the helical gear to research with three states: normal, chipped tooth and broken tooth, and the sampling frequency can be taken as 1024 Hz. The vibration signals of helical gear with three conditions (normal, chipped tooth and broken tooth) were tested, and 40 vibration signals from the helical gear in each condition were taken from 6 groups collected at random as the test data.
Fig. 7. Common test rig
Firstly, the vibration signals of each group with three conditions named as normal, chipped tooth and broken tooth were decomposed by LCDMPE into a number of ISCs. The first seven ISCs embrace the most dominant information which is selected and arranged in accordance with the frequency components as ${c}_{1}\left(t\right),{c}_{2}\left(t\right),\dots ,{c}_{8}\left(t\right)$ from high to low. Then, the fault features vector $T$ was obtained following the MPE method. Finally, the BSASVM was used to identify the various patterns. In order to have a fair comparison, the original vibration signals are chosen similarly. These signals are decomposed by LCD into ISCs, of which, the first eight IMFs are selected and arranged in the manner of high to low values basing on frequency components as ${c}_{1}\left(t\right),{c}_{2}\left(t\right),\dots ,{c}_{8}\left(t\right)$. And then, the feature vector is taken into the input of BSASVM. The identification results for the test samples based on LCDMPE and compared with EMD and EEMD method are shown in Table 5.
The input vector of the BSASVM method uses the LCD or EMD analysis as preprocessor to extract the energy in each frequency band in identifying the fault gears. These input vectors affect the identification of the fault gears. The frequency components after decomposition by LCDMPE has better results than the ones in the EMD and EEMD method, therefore, the method BSASVM based on LCD is better than that based on EMD. The experimental results were demonstrated in Table 5 and Fig. 8. As a result, the accuracy of identification is good, and the time is shorter. In practical cases, they may be used for a fault diagnosis.
Table 5. Gear fault diagnosis results based on LCDMPE or EEMDMPE or EMDMPE
Signal

Method

${E}_{1}$

${E}_{2}$

${E}_{3}$

${E}_{4}$

${E}_{5}$

${E}_{6}$

${E}_{7}$

${E}_{8}$

Test error

S_{1}

LCD

0.6841

0.5156

0.4611

0.4267

0.2591

0.1648

0.0772

0.0239

Normal (0 %)

EMD

0.6235

0.4649

0.4299

0.4010

0.1801

0.1252

0.0369

0.0127

Normal (2.18 %)


EEMD

0.6518

0.5233

0.3836

0.2925

0.2451

0.0849

0.0327

0.0059

Normal (1.09 %)


S_{2}

LCD

0.7329

0.5182

0.4869

0.4218

0.2234

0.1152

0.0993

0.0072

Chipped tooth (0 %)

EMD

0.6946

0.4619

0.4461

0.3967

0.1846

0.0946

0.0856

0.0061

Chipped tooth (2.18 %)


EEMD

0.7358

0.5821

0.4812

0.3519

0.2183

0.0612

0.0319

0.0052

Chipped tooth (1.09 %)


S_{3}

LCD

0.7365

0.5285

0.4965

0.4378

0.1958

0.0983

0.0941

0.0041

Broken tooth (0 %)

EMD

0.6562

0.4925

0.4521

0.3876

0.1732

0.0729

0.0873

0.0037

Broken tooth (2.18 %)


EEMD

0.6832

0.4719

0.4028

0.4001

0.1296

0.0652

0.0372

0.0062

Broken tooth (1.09 %)

Fig. 8. Results based on LCDMPE or EEMD for gear fault diagnosis
7. Conclusions
Basing on the feature of nonstationary of gear fault signals, a method of diagnosing a faulty gear based on the LCDMPE and BSASVM is proposed. LCD and MPE were firstly used to preprocess different types of vibration signals. BSA was then employed to make the optimization for the parameters of SVM aiming at increasing the sensitivity and accuracy of SVM. This combination used to classify data of the work condition of the gear is called as BSASVM. When the working condition of gear changes, then the fault feature extraction is also changed indicating that the energy of each frequency component is changed when the gear with different faults is operating. Thus, the feature vector of each ISC component is adopted as input features for BSASVM to identify the gear work condition. Based on experimental results, some conclusions of the paper are:
(1) LCD is a method of processing selfadaptive signals, which can be applied to nonlinear and nonstationary processes faultlessly.
(2) BSA is an optimal algorithm that is used to make the optimization for the parameters of SVM network. Experimental results above show that the BSA and SVM combine better than other optimization algorithms (GA, PSO) combined with SVM.
(3) The successful combination of LCDMPE with BSASVM identifies the work condition and fault patterns for the gears and provides an effective tool for intelligent fault diagnosis of gears.
(4) The BSASVM method that took the fault feature vector of each frequency component based on LCD combined with MPE as the input features has greater identification power than that based on EMD or EEMD combined with MPE.
In short, the paper presents another approach to gear fault diagnosis using a chain of data mining methods. Firstly, the LCD is used for vibration signals decomposition. The LCD is an improved form of the HuangHilbert Transform. Thanks to this, the problem of the mode mixing in this transform is removed. It is well visible in diagnosis results presented in Table 5. Next, the MPE is calculated as a feature characterizing each ISC obtained after signal decomposition by the LCD method. Then the MPEs values obtained in all scales are used as the feature vector to SVM classifier. However, the paper authors have improved the effectiveness of this classifier by optimizing its parameters with the aid of backtracking search optimization algorithm (BSA). Thanks to such a novel approach to the whole procedure of data mining applied to gear fault diagnosis they propose a very effective methodology which is able to perform the bearing different fault type diagnosis in a very reliable and robust way. According to the results presented in Table 5, the combination of LCDMPE with BSOASVM can identify the work condition and fault patterns of the gears with the test error equal to 0 % for all the tested cases.
Acknowledgements
The authors first would like to thank the financial support by the Chinese National Science Foundation Grants (No. 51375152 and 51175158). The authors also would like to thank the support from the Collaborative Innovation Center of Intelligent New Energy Vehicle, and the Hunan Collaborative Innovation Center for Green Cars.
References
 Cui L., Yao T., Zhang Y., Gong X., Kang C. Application of pattern recognition in gear faults based on the matching pursuit of a characteristic waveform. Measurement, Vol. 104, 2017, p. 212222. [Publisher]
 Zheng Z., Jiang W., Wang Z., Zhu Y., Yang K. Gear fault diagnosis method based on local mean decomposition and generalized morphological fractal dimensions. Mechanism and Machine Theory, Vol. 91, 2015, p. 151167. [Publisher]
 Ao H., Cheng J., Yang Y., Truong T. K. Support vector machine parameter optimization method based on artificial chemical reaction optimization algorithm and its application to roller bearing fault diagnosis. Journal of Vibration and Control, Vol. 21, Issue 12, 2013, p. 24342445. [Publisher]
 Luo S., Cheng J., Ao H. Application of LCDSVD technique and CROSVM method to fault diagnosis for roller bearing. Shock and Vibration, Vol. 1, 2015, p. 20158. [CrossRef]
 Cheng J., Yu Tang D. J., Yang Y. Local rubimpact fault diagnosis of the rotor systems based on EMD. Mechanism and Machine Theory, Vol. 44, Issue 4, 2009, p. 784791. [Publisher]
 Le D., Cheng J., Yang Y., Tran T., Pham V. Gears fault diagnosis method using ensemble empirical mode decomposition energy entropy assisted ACROARBF neural network. Journal of Computational and Theoretical Nanoscience, Vol. 13, Issue 5, 2016, p. 32223232. [Publisher]
 Le D., Cheng J., Yang Y., Pham M., Thai V. Gear fault diagnosis method based on local characteristicscale decomposition multiscale permutation entropy and radial basis function network. Journal of Computational and Theoretical Nanoscience, Vol. 14, Issue 10, 2017, p. 50545063. [Publisher]
 Zhang X., Qiu D., Chen F. Support vector machine with parameter optimization by a novel hybrid method and its application to fault diagnosis. Neurocomputing, Vol. 149, 2015, p. 641651. [Publisher]
 Bordoloi D. J., Tiwari R. Optimum multifault classification of gears with integration of evolutionary and SVM algorithms. Mechanism and Machine Theory, Vol. 73, 2014, p. 4960. [Publisher]
 Saravanan N., Siddabattuni V. N. S. K., Ramachandran K. I. Fault diagnosis of spur bevel gear box using artificial neural network (ANN), and proximal support vector machine (PSVM). Applied Soft Computing, Vol. 10, Issue 1, 2010, p. 344360. [Publisher]
 Chen D., Lu R., Zou F., Li S., Wang P. Learning and niching based backtracking search optimisation algorithm and its applications in global optimisation and ANN training. Neurocomputing, Vol. 266, 2017, p. 579594. [Publisher]
 Mandal S. R. S., Mittal K. Comparative analysis of backtrack search optimization algorithm (BSA) with other evolutionary algorithms for global continuous optimization. International Journal of Computer Science and Information Technology, Vol. 6, 2015, p. 323741. [CrossRef]
 Civicioglu P. Circular antenna array design by using evolutionary search algorithms. Progress in Electromagnetics Research, Vol. 54, 2013, p. 26584. [CrossRef]
 Shafiullah A. M. M., Coelho L. S. Design of robust PSS in multimachine power systems using backtracking search algorithm. 18th International Conference on Intelligent System Application to Power Systems, 2015. [CrossRef]
 Attia ElFergany Multiobjective allocation of multitype distributed generators along distribution networks using backtracking search algorithm and fuzzy expert rules. Electric Power Components and Systems, Vol. 44, Issue 2016, 3, p. 252267. [CrossRef]
 Chaib A. E., Bouchekara H. R. E. H., Mehasni R., Abido M. A. Optimal power flow with emission and nonsmooth cost functions using backtracking search optimization algorithm. International Journal of Electrical Power and Energy Systems, Vol. 81, 2016, p. 6477. [Publisher]
 Li Y., Xu M., Wei Y., Huang W. New rolling bearing fault diagnosis method based on multiscale permutation entropy and improved support vector machine based binary tree. Measurement, Vol. 77, 2016, p. 8094. [Publisher]
 Zheng J., Cheng J., Yang Y. Rolling bearing fault diagnosis approach based on LCD and fuzzy entropy. Mechanism and Machine Theory, Vol. 70, 2013, p. 441453. [Publisher]
 Liu H., Wang X., Lu C. Rolling bearing fault diagnosis based on LCDTEO and multifractal detrended fluctuation analysis. Mechanical Systems and Signal Processing, Vol. 60, Issue 61, 2015, p. 273288. [Publisher]
 Deng W. W. Y., Qian C., Wang Z., Dai D. Boundaryprocessingtechnique in EMD method and Hilbert transform. Chinese Science Bulletin, Vol. 46, 2001, p. 954960. [Publisher]
 Costa A. L. G. M., Peng C. K. Multiscale entropy analysis of complex physiologic time series. Physical Review Letters, Vol. 92, 2002, p. 68102. [CrossRef]
 Ebbesen S., Kiwitz, Guzzella L. Generic particle swarm optimization Matlab function. Proceedings of the American Control Conference, 1519, p. 15242012. [CrossRef]
 Wang Y., Cai, Zhang Q. Differential evolution with composite trial vector generation strategies and control parameters. IEEE Transactions on Evolutionary Computation, Vol. 15, 2011, p. 5566. [Publisher]
 Lin S. W., Ying K. C., Chen S. C., Lee Z. J. Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Systems with Applications, Vol. 35, 2008, p. 18171824. [Publisher]
 Civicioglu P. Backtracking search optimization algorithm for numerical optimization problems. Applied Mathematics and Computation, Vol. 219, Issue 15, 2013, p. 81218144. [Publisher]
 Cervantes J., Garcia Lamont F., Rodriguez L., López A., Castilla J. R., Trueba A. PSObased method for SVM classification on skewed data sets. Neurocomputing, Vol. 228, 2017, p. 187197. [Publisher]
 Huang Y., Wu D., Zhang Z., Chen H., Chen S. EMDbased pulsed TIG welding process porosity defect detection and defect diagnosis using GASVM. Journal of Materials Processing Technology, Vol. 239, 2017, p. 92102. [Publisher]
 Jafrasteh B., Fathianpour N. Hybrid simultaneous perturbation artificial bee colony and backpropagation algorithm for training a local linear radial basis neural network on ore grade estimation. Neurocomputing, Vol. 235, 2017, p. 217227. [Publisher]
 Society P. Data Analysis Competition. http://www.phmsociety.org/competition/PHM/09/apparatus, 2009. [CrossRef]