Theoretical aspects of creation of intellectual systems technological rationing in mechanical engineering

1. Introduction

Almost any enterprise engaged in the production of engineering products in the current market conditions is faced with the need for a rough estimate of the complexity of the product without the design process [1]. This is especially true for small-scale and individual productions. Preliminary assessment of the complexity in the design stage of pre-production can help to determine the feasibility of entering new products into production, and its future costs [2].

2. A method for constructing fuzzy decision trees

Each decision tree generates a certain set of rules. If you use the algorithm of decision trees to generate fuzzy rules, you can go to the fuzzy inference system.

The algorithm of fuzzy inference on the basis of a decision tree.

We consider the decision tree constructed as a set of fuzzy rules of the form $R_r:$ if $\bigcap x_i\in A_{ir}$ then $y$ is $B_r$, $r=1,K_R$.

Conditions $x_i\in A_{ir}$ corresponds of the condition to the separation the set of objects $x_i\lessgtr \left(w_{ij}\right)$, $i=\overline{1,m-1}$; $j=\overline{1,n}$ means entering the value $x_i$ in the fuzzy interval $w_{ij}^{\pm }$ with membership functions:

Function of accessory ${\mu }^{+}\left(x_i\right)$ corresponds to a condition of $x_i\ge \left(w_{iq}\right)$, and ${\mu }^{-}\left(x_i\right)$ to a condition of $x_i<\left(w_{iq}\right)$.

The graphs of membership functions are shown in Fig. 1 and Fig. 2.

The value $\beta$ characterizes the blur interval. When $\beta \to \mathrm{\infty }$ fuzzy interval returns to normal.

For a given vector $\mathbf{x}$ are determined by the degree of truth for each rule: ${\alpha }_r$, $r={\overline{1,K}}_R$. Degrees of truth correspond to the values of membership functions of the left sides (prerequisites):

where $g_r$ – the number of terms in this rule $R_r$.

Fig. 1The functions of fuzzy intervals (β= 10)

Fig. 2The functions of fuzzy intervals (β= 50)

As a result, the aggregate output signal is determined by the formula:

Coefficients $p_{rj},r=\overline{1,K_R}$; $j=\overline{0,n}$ are determined by the available training set using pseudoinversion procedure. $\left({\mathbf{x}}^q,d^q\right)$, $q=1,H$ training samples are used for training. Under fixed rates ${\alpha }_i^q$ is written $y\left({\mathbf{x}}^q\right)=d^q$, $q=\overline{1,H}$ in the form of a system of linear algebraic equations:

or $\mathbf{G}\mathbf{P}=\mathbf{d}$. If the number of equations $H$ is greater than the number of unknowns $M(N+1)$, the matrix $\mathbf{G}$ has a rectangular shape. In this case, use pseudoinversion operation. To this end, the transposed matrix ${\mathbf{G}}^T$ is multiplied by the left and right side of the equation $\mathbf{G}\mathbf{P}=\mathbf{d}$. The resulting matrix equation ${\mathbf{G}}^T\mathbf{G}\mathbf{P}=\mathbf{d}$ is solved with respect to the unknown vector $\mathrm{P}=\left[p_{ij}\right]$: $\mathbf{P}={\mathbf{G}}^{+}\mathbf{d}$, where ${\mathbf{G}}^{+}={\left({\mathbf{G}}^T\mathbf{G}\right)}^{-1}{\mathbf{G}}^T$.

The output value of the network are as follows: $\mathbf{y}=\mathbf{G}\mathbf{P}$, $\mathbf{y}={\left[y^1,...,y^H\right]}^T$.

Thus, we obtain the following algorithm for constructing a fuzzy decision tree. On a set of training data is constructed a decision tree with the classes of discrete values of the output variable. Formed rules. Sets the type of membership functions for the conditions. Calculates the degree of truth for each rule. Is determined by a set of training data weights $p_{rj},r=\overline{1,K_R}$; $j=\overline{0,n}$. It calculates the continuous value of output variable in accordance with the fuzzy inference of Sugeno. Along with the Sugeno [6] fuzzy inference can be made on the conclusion by Mamdani [7]. In this case, stored steps 1-4 algorithm. Specifies membership function for the right side of the rules. Number of membership functions is equal to the number of classes $K$, which divided the output variable. We have dealt with triangular membership functions. Implemented maximum composition or combination of features obtained: $\mu \left(y\right)=\underset{r}{\mathrm{m}\mathrm{a}\mathrm{x}}\left(B_r\left(y\right)\right)$. By using centroid method of defuzzification is carried out and the evaluation is $y$ [3].

3. The results of the numerical experiment testing the method of fuzzy decision trees

The above algorithms were tested on a test considered the function $\psi \left(x_1,x_2\right)$. In Fig. 3 shows the reconstructed surface of the function $\psi \left(x_1,x_2\right)$.

The entire sample is divided into two equal parts. Constructing a tree corresponds to 57 units, 29 of the rules, $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}=$ 10. The mean square error on the test sample was 2.66 %.

An even better result is achieved by increasing the number of classes to $K=$ 10. The mean square error on the test sample is 0.78 % and 0.25 % of the training. This tree contains 93 rules for $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}=$ 5.

Fig. 3Recovery of function ψ as a result of fuzzy inference on Sugeno (K= 5)

In the tree structure and, consequently, the accuracy of the forecast is influenced by various factors [5]: the setting of membership functions $\beta$; the minimum number of elements in the set are separated by $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$; the ratio of the volume of training and test samples.

Fig. 4 shows the value of the mean square error recovery on the value of $\beta$ to $K=$ 3, $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}=$ 3. On Fig. 4 thin lines correspond to the fuzzy inference by Sugeno (solid – test sample, open circles – training). The increase in $\beta$ reduces the errors in the derivation by Mamdani. There is an optimal value of the parameter $\beta =$ 10, and is laid in the subsequent calculations for Sugeno fuzzy inference. To output on Mamdani value assumed $\beta =$ 50. Fig. 4 also implies that the magnitude of the approximation error test function $\psi \left(x_1,x_2\right)$ for fuzzy inference by Mamdani significantly higher (10.8 % for $\beta =$ 50 for sample screening) than to output on Sugeno (1.9 % at $\beta =$ 10 as the test sample).

On the complexity of the tree affects the minimum size of the shared sets $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$. In Fig. 5 shows the number of rules that characterize the tree, the size of $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$.

From Fig. 5 it follows that an increase in the size of $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$ leads to a simplification of the tree structure and to reduce the number of rules for any number of classes from $K=$ 3 to $K=$ 10. Increasing the number of classes $K$ also complicates the tree and increases the number of rules.

Since the increase in the size of the set of shared $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$ affect the structure of the tree, it was studied numerically, depending on the value of the prediction error $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$. The results are shown in Fig. 6, 7.

With increasing numbers of $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$ error on the training sample has a tendency to increase due to the formation of mixed grades.

On the test sample with an increase in the number of classes we observed the appearance of a certain optimum value $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$. This results in the test sample is an indicator of the quality of learning and generalizing patterns.

Fig. 4The dependence of an error recovery on parameter fuzziness interval

Fig. 5The dependence of number of rules on the minimum size of the divided set

Fig. 6The dependence of the reconstruction error of the minimum separating set (training sample)

Fig. 7The dependence of the reconstruction error of the minimum separating set (the test sample)

For small $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$ of the tree structure is too complex, and the ability to generalize reduced. On the training sample did not occur because there is data storage. Here, the same effect as in retraining the neural network. If the allowable size of the shared the set of substantially increased, the formation of mixed classes starts increasing forecast accuracy.

The presented results are obtained when the ratio of training and test samples 50-50. Fig. 8 shows the effect of partitioning the training set of predictive accuracy.

forecasting error was determined on the test sample. Plearn = 0.8 means that the amount of training samples is 80 % of the total amount of data, and on the test sample accounts for 20 %. Meaning Plearn = 0.25 corresponds to the situation: 25 % – training sample, 75 % – screening. Reducing the amount of data available for training, increases the error. Particularly strong increases uncertainty for large values of $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$. According to Fig. 8 corresponds to the number of classes $K=$ 5.

A suitable value prediction error of 3.25 % was obtained by reducing the volume of training sample to 10 %. Reducing the amount of training data for up to 5 % results in poor prediction quality. However, a discrete classification gives 69 % of correct partition classes. In case of the continuous output variable computation of coefficients of $p_{rj},r=\overline{1,K_R}$; $j=\overline{0,n}$ on the available training selection using the procedure of pseudo-inverse is required. For a small amount of sample matrix $\mathbf{G}$ approaching to the square, and the ability to generalize the fuzzy tree is sharply reduced. Changing the number of rules and forecasting errors with the increasing volume of training data is shown in Fig. 9.

Number of rules $K_R$ is increased, improving the coverage of the rules of all the examples from the training set and the prediction error is reduced.

Compare calculated by the proposed method of fuzzy trees and the actual values of the test functions for training and screening of samples is shown in Fig. 10.

The correlation coefficient for the training sample was 0.9992 and 0.9963 for the test. The corresponding values of the mean square error was 0.53 % and 1.21 %.

Fuzzy conclusion on Mamdani does not receive the benefits in comparison with the conclusion by Sugeno in all cases except one. As noted above, for a small number of snapshots determining weighting factors using pseudoinversion operation leads to a large prediction error. Fuzzy conclusion on Mamdani by giving a more realistic value of the output variable.

Fig. 8The dependence of the reconstruction error of the minimum shared set under a different ratio of the volume of training and test samples

Fig. 9Influence of the volume ratio of the training and test samples to recover the error and the number of rules

Fig. 10Comparison of the calculated method of fuzzy trees and the actual values of the test function: a) training sample, b) screening sample

a)

b)

An algorithm for constructing a fuzzy decision tree is characterized by a small number of settings. Actually these three parameters: index of fuzziness interval $\beta$, the size of shared set $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$ and the number of classes into which the continuous values of the output variable $K$. If the output is a discrete variable, then the value $K$ is uniquely determined. For a continuous function select value enough $K$ of the $K\in$[2, 5] range. The value $\beta =$ 10 is optimal for output by Sugeno, and $\beta =$ 50 for fuzzy inference according to Mamdani. Setting the size of shared the set $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}$ is dependent on the type of the analyzed data. If the data are characterized by high noise and the sample size is large enough, then the value $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}=$ 20-50. If the data is consistent $N_l^{\mathrm{m}\mathrm{i}\mathrm{n}}=$ 3-5. Education fuzzy tree actually does not require iterations. Construction of the tree allows a single step to determine the weights and train the system. Building a tree with the number of nodes of 500 does not take more than a 1 second on a standard PC, the definition of the weighting factors to the number of rules 120-150 requires 3-5 seconds. These computational cost significantly lower than required in the training of neural networks. The algorithm is suitable to solve both problems of classification, and approximation.

4. The addition of expert rules

If necessary, the possible involvement of experienced experts to add rules that determine some of the properties the product in question and the impact on the amount of labor input [4]. These rules have the general form: $R_l:$ if $\bigcap x_i\in A_{il}$ then $y$ is $B_l$, $l={\overline{1,K}}_l$.

Now, the condition $x_i\in A_{il}$ is the value of $x_i$ to hit one of the intervals into which the range of the broken down of $x_i$. In this way, $A_{il}=\left[B{L}_{il}^k,B{R}_{il}^k\right]$, $k=1,K_T$, where $B{L}_{il}^k,B{R}_{il}^k$ – left and right boundaries of the intervals (tones). At each interval set membership function: ${\mu }_{il}^k\left(x_i\right)$, $i=\overline{1,n}$; $l=\overline{1,K_l}$; $k=\overline{1,K_T}$.

Membership functions can be set triangular, trapezoidal or in the form of a Gaussian function.

Aggregate output signal is given by Sugeno:

After adding the new rules coefficients $\mathbf{P}=\left[p_{ij}\right]$ recalculated with the calculation of a new matrix $\mathbf{G}$.

5. Conclusions

The advantages of fuzzy expert systems are: the ability to parallel execution of existing rules; the multiplicity of interpretations of variables, providing superposition of states and the possibility of conflicting rules; prediction of new state of the system; description of the problem and the rules of natural language using the linguistic variables.

Thus, the process of construction of adaptive fuzzy system is always reduced to the solution of a finite set of optimization problems. View optimization function depends entirely on data from the training set. Finding global extremum of this function by traditional methods of optimization is a difficult, and often impossible task. Therefore, new hybrid algorithms should be used for training the fuzzy system.

Information systems, applying the methods of fuzzy logic, provide a more stable and complete understanding of existing knowledge about a certain subject, as compared to traditional expert systems. Therefore, they are widely used in tasks of decision making under uncertainty.