Modeling method of failure dependent system based on time varying copula function
Mengli Xing^{1} , Dan Xu^{2} , Jiaolan He^{3}
^{1, 2, 3}School of Reliability and Systems Engineering, Beihang University, Beijing, China
^{1}Corresponding author
Vibroengineering PROCEDIA, Vol. 14, 2017, p. 7681.
https://doi.org/10.21595/vp.2017.19172
Received 19 September 2017; accepted 26 September 2017; published 21 October 2017
JVE Conferences
This paper aims at solving the dynamic correlation of the complex dependence system with multiple failures. A correlation model and parameter estimation method based on timevarying copula function are proposed to solve the joint distribution between the interaction mechanism. In particular, three types of definition method for the timevarying copulas’ parameters are introduced. Finally, a comparative study and applicability analysis are performed to validate our proposed method.
Keywords: complex dependence system, timevarying copula, joint distribution.
1. Introduction
In reality, there are several failure modes for a complex system with multiple components and complicated structure when subjected to the diverse running environment. In general, the relationship between the failure modes will change with the use of equipment. According to the classification of the failure behavior modeling, this correlation can be reflected by the failure variable of each component or the performance parameters of the system. In this paper, based on the performance parameters of the system, we proposed a modeling method to study the correlation between the dynamic failure model.
Reviewing previous studies, we can find that the research on the failure dependent system mainly concentrate on two aspects: one aspect is based on the components to establish the logical model of the system and parameter model, and specific parameters of common cause are introduced to quantify the influence of the common cause failure [14]. the other aspect is typical failure modeling approach based on the observation data of performance parameters. It’s noted that there often exists dependent relationship between the performance parameters of the system due to the common cause failure, therefore some scholars utilized stochastic process or other statistical method to model the distribution of performance parameters, and finally copula function is introduced to establish the reliability model of the system [58]. Copula can be divided into two categories according to whether its parameters are timevarying or not: type I and type II, that is, static copula and dynamic copula. For the former, its parameter is a constant timeindependent value that stands for the constant dependency structure between variables, which is widely used in the reliability modeling of joint distribution [9, 10]. However, considering the dependence between variables fluctuated due to the change of the external environment, timevarying copula model is proposed to study the dependent relationship between two or more variables over time. The key to construct the timevarying copula model is to give the evolution equation of parameters of the copula function. However, there is no point in forcing a variable to follow a certain process without knowing the meaning and influence of the parameter.
According to the different specification of timevarying parameters, Patton [11] proposed a similar ARMA (1, 10) process to describe the related parameters of two normal copula function; Manner and Hafner [12] proposed the stochastic autoregressive copula model(SCAR), where the timevarying copula parameter is a transformation of a latent Gaussian AR(1) process; Creal et al. [13] presented a generalized autoregressive score (GAS) model, which not only assumes an latent process for the parameter, but also utilized the weighted score of the underlying model to drive the latent process. In addition, DCC model [16] and semiparametric approach [17] were also introduced to the definition for dynamic copula parameters. The methods above have one similarity, that is they all used the feature that there is the onetoone relationship between the parameters of copula and correlation coefficient. Therefore, once the correlation coefficient of copula function is determined, the corresponding evolution equation of copula function parameter will be determined. However, it’s noticed that all these timevarying copula model are derived from the financial field, and are particularly scarce in the field of reliability. It’s worth noting that the latest application research in reliability is still stuck in bivariate timevarying copula [18], and its timevarying parameter definition method is still based on the theory presented by Patton in 2006, without new breakthrough. Therefore, in order to conduct the reliability modeling method for the complex system with dependent multiple variables, especially considering the timevarying nonlinear correlation between failure modes, a proper modeling method needs to be further studied.
2. Multivariate coupling modeling method based on time varying copula
Copula theory provides a theoretical basis for the construction of coupled multivariate model. As the function connecting the marginal distribution and the random variable, copula can not only describe the correlation between random variables, but also reflect the dependency structure. Based on copula function, the construction of the multivariable joint distribution model is mainly divided into two steps: one step is to determine the marginal distribution model of each variable; the other step is to select the most appropriate copula function to fuse marginal distribution according to the characteristics of different copula function.
2.1. Selection of the marginal distribution
The selection of the marginal distribution model can be considered from two aspects:
i) Acquisition of the marginal distribution based on statistical model.
Take degradation modeling as an example: According to the characteristic of the degradation path, we can use degradation data for statistical inference to obtain the degradation model. In the process, different statistical model can be introduced, then the corresponding marginal distribution form can be determined. However, the hypothesis test of distribution is necessary when using this method
ii) Acquisition of marginal distribution based on empirical model.
When the specific form of the distribution is unknown, the empirical distribution model can be used to simulate the distribution function. At this time, by empirical distribution, the marginal distribution can be expressed as:
After determining the marginal distribution of each variable, we can choose different copula forms to establish the coupling model according to the different feature of copula function.
2.2. The selection of timevarying copula
In this paper, we focus on three types of timevarying parameter definition methods: the generalized autoregressive score model (GAS model), the autoregressive conditional parameter model (ACP) based on Patton’s theory, and the SCAR model, which is introduced to study their modeling method and application in the field of reliability for multiple failure dependent systems.
Let ${y}_{t}=\left({y}_{1,t},\dots {y}_{\mathrm{p},t}\right)t=\mathrm{1,2},...T$ denotes a sequence of $T\times p$ dimensional failure variable, according to Sklar’s theorem, there exists copula function:
where ${F}_{i,t}$ is the distribution of the $i$th failure variable. We can define ${u}_{i,t}={F}_{i,t}$, then assume that arbitrary time series of distribution of bivariate failure variables follows the distribution $\left({u}_{i,t},{u}_{j,t}\right)~C\left(.,.;{\theta}_{t}\right)$, where ${\theta}_{t}$ is the timevarying parameter of copula, and generally can be expressed by ${\theta}_{t}=\mathrm{\Lambda}\left({\lambda}_{t}\right)$. It has been found that there is a onetoone transition between copulas’ parameter and Kendall’s coefficient $\tau $, then ${\theta}_{t}=r\left({\tau}_{t}\right)$. As mentioned above, the evolution equation of the correlation coefficient $\tau $will be given based on the GAS (1, 1) model, the SCAR model and the Patton’s model, respectively.
In GAS (1, 1) model, we have:
In Eq. (3), ${s}_{t}={S}_{t}{\nabla}_{t}$ is the scaled score vector corresponding to the loglikelihood function, where ${\nabla}_{t}$ can be expressed as:
where $\varpi =\left(\omega ,\beta ,\alpha \right)$, the scaling matrix ${S}_{t}$ is the square root matrix of the inverse matrix of the information matrix, which can be defined as:
where ${I}_{tt1}={E}_{\mathrm{t}1}\left[{\nabla}_{t}{{\nabla}^{\mathrm{\text{'}}}}_{t}\right]$ is the information matrix.
As Patton’s theory, timevarying JoeClayton copula model and normal copula model were presented, where the timevarying parameter $\rho $ in the normal copula function can be described as a similar ARMA (1, 10) process, then we have:
In this paper, Patton's theory is extended and summarized. The dynamic Clayton copula function and the dynamic Gumbel copula function are introduced to measure the asymmetric dependence of multiple variables. Since the Clayton copula is more sensitive to the change of the lower tail, and the Gumbel copula is more sensitive to the change of the upper tail, so we use the Clayton copula to describe the stronger relationship in lower tail, while the Gumbel copula is used to describe the stronger relationship in upper tail. For these two copula functions, the equation is defined as follows:
In SCAR function, its parameter is driven by an independent random process. Generally, the timevarying parameters can be denoted as ${\theta}_{t}=\mathrm{\Lambda}\left({\lambda}_{t}\right)$, where the underlying process ${\left\{{\lambda}_{t}\right\}}_{t=1}^{T}$ is assumed to obey a Gaussian autoregressive process as:
where ${\eta}_{t}$ is the i.i.d. standard normal distribution, and $\left\beta \right<1$ ensures the stationarity of ${\lambda}_{t}$. In the estimation of the parameters, the solution of the timevarying coefficients cannot be directly carried out restricted that ${\lambda}_{t}$ is a hidden process. Under such circumstance, the likelihood function of the timevarying parameter $\varpi $ can be achieved through the integration of the hidden process, namely:
To solve this multidimensional integral, the numerical solution can be obtained by Monte Carlo integral based on the effective importance sampling (EIS) [15] method.
3. Case study
In this paper, electronic smart meter is selected as a case study, where a comprehensive environmental test with two stress (temperature: 70 °C and humidity: 95 %) is conducted for the smart meter. The smart meter is a product with many failure dependent components and the failure correlation can be characterized by the output parameters, so we use the data of output performance parameters collected from the test and failure characterization to study the dynamic modeling method for the system failure. In the test, the data of two key characteristics performance parameters is obtained, and the corresponding trajectories of test data are shown in Fig. 1.
Fig. 1. Observation data of the key performance characteristics of electric smart meters
Through the analysis of the observation of the characteristic performance parameter, we can find that the data presents fluctuation. At the same time, the observation data of the performance characteristic at the time $t$ is not a fixed value, but follows a distribution due to the influence of the sample dispersion. Consider that the specific distribution is unknowable and the assumed distribution type may cause errors to the modeling results, empirical cumulative distribution method is introduced to derive the value of the distribution. Finally, ${F}_{i,t}$, the distribution of $i$th performance characteristic at each time t is computed.
Fig. 2. The curve of timevarying parameter ${\theta}_{t}$ based on Patton’s model
Having obtained the distribution function of the performance characteristic, three types of time varying copulas: Clayton copula, Gumbel copula and Gaussian copula as alternative copula functions were used to establish the joint distribution and to measure the dependence structure between the two performance characteristics, where the definition method of timevarying copulas’ parameters are chosen based on the GAS model, SCAR model and Patton‘s theory. Finally, the estimation results of the timevarying parameter model are shown in Tables 13, besides, we can get the curve of timevarying parameters in copula, taking Patton‘s model for an example, the curve of timevarying parameters ${\theta}_{t}$ are shown in Fig. 2.
Table 1. Parameter estimation of timevarying copula based on GAS (1, 1)
Copula

Type

$\theta $

$\varpi $

AIC

LL

Ranking


Normal

Dynamic

–

1.2

–0.006

–1.37

–60.18

33.09

2

Gumbel

Dynamic

–

0.63

8.34

–2.60

–29.32

15.66

4

Clayton

Dynamic

–

0.56

3.06

–1.37

–77.20

41.60

1

Normal

Static

0.18

–

–

–

–9.260

5.630

5

Gumbel

Static

2.13

–

–

–

–5.864

3.962

6

Clayton

Static

8.65

–

–

–

–38.762

20.381

3

Table 2. Parameter estimation of timevarying copula based on Patton’s model
Copula

Type

$\theta $

$\varpi $

AIC

LL

Ranking


Normal

Dynamic

–

2.908

0.018

1.743

–37.68

21.84

2

Gumbel

Dynamic

–

0.194

0.309

0.129

–29.24

17.62

3

Clayton

Dynamic

–

0.109

0.188

0.044

–61.20

33.60

1

Normal

Static

0.18

–

–

–

–9.260

5.630

6

Gumbel

Static

2.13

–

–

–

–5.864

3.962

5

Clayton

Static

8.65

–

–

–

–28.952

15.476

4

Table 3. Parameter estimation of timevarying copula based on SCAR model
Copula

Type

$\theta $

$\varpi $

AIC

LL

Ranking


Normal

Dynamic

–

0.13

0.25

0.036

–65.00

35.50

2

Gumbel

Dynamic

–

0.03

0.28

0.060

–17.66

11.83

4

Clayton

Dynamic

–

0.56

0.37

0.043

–128.02

67.01

1

Normal

Static

0.18

–

–

–

–9.920

5.960

5

Gumbel

Static

2.13

–

–

–

–5.240

3.62

6

Clayton

Static

8.65

–

–

–

–38.26

20.13

3

From the table above, we can find that the correlated relationship between characteristic performance parameter is not constant from the value of $\varpi $, but changeable with a period of time, and the change of copulas’ parameters is due to the impact of external environment. Therefore, the modeling method based on static copula is often not a good choice, as contrast, timevarying copula should be considered to simulate the joint distribution of multiple variables. Meanwhile, three types of timevarying parameter definition methods are used to get the same result, and the result shows that the optimal copula function is Claytoncopula. Specifically, the dynamic Clayton copula is selected as the optimal copula function, which reflects the asymmetric dependence between the two characteristic performance parameter. Besides, it should be noted that the static Gaussian copula function is less effective in the construction of the joint distribution, which is due to the asymmetric correlation between the data. The dynamic Gaussian copula function is better than the static Gaussian copula, as presented, the dynamic Gaussian copula function exhibits better tail correlation than the static copula function.
4. Conclusions
In this paper, three types of definition model of timevarying copulas are introduced to build the joint distribution model for complex system with correlated failure modes. The parameters of copulas change over time, which are defined as timevarying copula parameters. The modeling results of timevarying copulas reflect the changeable dependence among multiple marginal distribution. Compared with the static copula, the timevarying copula has different definition on the evolution process of copulas’ parameter, which resulted in the difference of joint distribution. It’s worth noting that the optimal type of copula is determined only by sample data rather than by timevarying parameters. Finally, the Claytoncopula is selected as the optimal copula by three types of definition model.
References
 O’Connor A., Mosleh A. A general cause based methodology for analysis of common cause and dependent failures in system risk and reliability assessments. Reliability Engineering and System Safety, Vol. 145, 2016, p. 341350. [Publisher]
 Li C., Chen X., Yi X., et al. Heterogeneous redundancy optimization for multistate seriesparallel systems subject to common cause failures. Reliability Engineering and System Safety, Vol. 95, Issue 3, 2010, p. 202207. [Publisher]
 Song L., Wang T., Song X., et al. Research and application of FTA and petri nets in fault diagnosis in the pantographtype current collector on CRH EMU trains. Mathematical Problems in Engineering, 2015, https://doi.org/10.1155/2015/169731. [Search CrossRef]
 Ding L., Wang H., Jiang J., et al. SIL verification for SRS with diverse redundancy based on system degradation using reliability block diagram. Reliability Engineering and System Safety, Vol. 165, 2017, p. 170187. [Publisher]
 Xiaogang L., Peng X. Multivariate storage degradation modeling based on copula function. Advances in Mechanical Engineering, 2014, https://doi.org/10.1155/2014/503407. [Search CrossRef]
 Liu Z., Ma X., Yang J., et al. Reliability modeling for systems with multiple degradation processes using inverse Gaussian process and copulas. Mathematical Problems in Engineering, 2014, https://doi.org/10.1155/2014/829597. [Search CrossRef]
 Hao H., Su C., Li C. LED lighting system reliability modeling and inference via random effects Gamma process and copula function. International Journal of Photoenergy, 2015, https://doi.org/10.1155/2015/243648. [Search CrossRef]
 Xu D., Wei Q., Elsayed E. A., et al. Multivariate degradation modeling of smart electricity meter with multiple performance characteristics via vine copulas. Quality and Reliability Engineering International, Vol. 33, Issue 4, 2017, p. 803821. [Publisher]
 Li X. Y., Liu Y., Chen C. J., et al. A copulabased reliability modeling for nonrepairable multistate koutofn systems with dependent components. Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability, Vol. 230, Issue 2, 2016, p. 133146. [Publisher]
 Jiang C., Zhang W., Han X., et al. A vinecopulabased reliability analysis method for structures with multidimensional correlation. Journal of Mechanical Design, Vol. 137, Issue 6, 2015, p. 113. [Publisher]
 Patton A. J. Modelling asymmetric exchange rate dependence. International Economic Review, Vol. 47, Issue 2, 2006, p. 527556. [Publisher]
 Hafner C. M., Manner H. Dynamic stochastic copula models: estimation, inference and applications. Journal of Applied Econometrics, Vol. 27, Issue 2, 2012, p. 269295. [Publisher]
 Almeida C., Czado C., Manner H. Modeling high‐dimensional time‐varying dependence using dynamic Dvine models. Applied Stochastic Models in Business and Industry, Vol. 32, Issue 5, 2016, p. 621638. [Publisher]
 Koopman S. J., Lucas A., Scharth M. Predicting timevarying parameters with parameterdriven and observationdriven models. Review of Economics and Statistics, Vol. 98, Issue 1, 2016, p. 97110. [Publisher]
 Richard J. F., Zhang W. Efficient highdimensional importance sampling. Journal of Econometrics, Vol. 141, Issue 2, 2007, p. 13851411. [Publisher]
 Manner H., Reznikova O. A survey on timevarying copulas: specification, simulations, and application. Econometric Reviews, Vol. 31, Issue 6, 2012, p. 654687. [Publisher]
 Hafner C. M., Reznikova O. Efficient estimation of a semiparametric dynamic copula model. Computational Statistics and Data Analysis, Vol. 54, Issue 11, 2010, p. 26092627. [Publisher]
 Wang Y., Pham H. Modeling the dependent competing risks with multiple degradation processes and random shock using timevarying copulas. IEEE Transactions on Reliability, Vol. 61, Issue 1, 2012, p. 1322. [Publisher]