Parametric identification of technological thermophysics processes based on neural network approach

In this paper, the inverse problem of technological thermophysics under the influence of disturbing factors is under study. In the problem of identifying the process of nonstationary heat conduction, it is required to concretize its mathematical model by qualitatively and quantitatively expressing an unknown characteristic based on the results of experimental studies. It is necessary to determine the uncontrolled time-varying heat flux density on the surface of the heated product from the noisy temperature measurement results at a certain point inside the object. The problem is formulated in an extreme setting as a problem of optimal control of an object with distributed parameters, in which the quadratic value of the temperature discrepancy between experimental and model data is used as an optimality criterion. The preliminary parametrization of the desired control on a compact set of polynomial functions implements the reduction to the parametric optimization problem. Physically substantiated solutions to inverse heat conduction problems are found as a result of their sequential parametric optimization using an algorithmically accurate method based on optimal control theory. The proposed solution combines the advantages of an accurate analytical method, which allows taking into account the physical essence of the process of interest and artificial intelligence methods, which provide great opportunities to find an quasioptimal solution under conditions of uncertainty in the mathematical description of the process. The analytical method of sequential parameterization provides a search for solutions on a compact set of smooth functions, as a result of which there is a reduction to the problem of parametric optimization. Measurement errors lead to processing large amounts of data, which necessitates the use of artificial neural networks for parametric optimization of the identified characteristics. The attained results confirm the possibility of obtaining adequate solutions to the inverse problems of thermal conductivity with the intensity of the measurement noise in the range of 0-15 %. In the investigated class of solutions, with a suitable setting of the ranges of belonging of the parameters, the error in approximating the temperature state can be up to 2-5 %, and the error in restoring the unknown characteristic can be up to 7-10 %.


Introduction
This work is devoted to the search for methods for solving inverse problems, formulated in relation to equations of mathematical physics of parabolic type and providing for the definition of an unknown function that sets the boundary conditions when the input data are not fully known. Objects described by equations of this class are characterized by the spatial distribution of the modeled state function, and in some cases, input quantities, and refer to the systems with distributed parameters. Mathematical models based on differential equations in partial derivatives of parabolic type are widely used in many industrial technologies to describe the processes of unsteady heat conduction, heat and mass transfer, unsteady diffusion, electromagnetic waves propagation, and others.
The main difficulty in solving inverse problems of mathematical physics (IPMP) is their belonging to the class of ill-posed problems, which necessitates the use of special numerical regularizing algorithms to obtain a stable solution [1], [2]. In the case of an unavoidable measurement error or other disturbances, the problem of constructing special regularizing algorithms for a stable solution of such problems becomes especially urgent [3], [4].
In the theory of inverse ill-posed problems of mathematical physics, a large number of methods and computational algorithms have been developed that make it possible to obtain regular solutions based, as a rule, on the use of smoothing functionals or additional restrictions on the class of sought solutions [5]- [7]. These approaches require significant computational efforts, depending on factors that are difficult to formalize [1], [2] or the availability of a priori information about the solution, which is usually absent [1], [4]. In such a situation, the development of methods for solving inverse and ill-posed problems of mathematical physics is an urgent problem. It makes possible to obtain stable solutions with satisfactory accuracy while reducing the computational complexity of methods and algorithms.
In the papers [8]- [11], the authors propose an analytical method of parametric optimization, which searches for solutions in the class of physically realizable functions based on their smoothness. The advantages of this approach are an accurate mathematical model that takes into account the qualitative physical laws and basic properties of the process under study, as well as displaying the solution in an analytical form, which provides benefits for its subsequent use in solving technological problems of various directions (control, monitoring, control, forecasting, diagnostics process and other tasks). The disadvantage of the approach may be its limited application under conditions of inevitable disturbing factors due to the sensitivity of the developed method, which uses analytical optimality conditions, to the level of input data error.
This paper presents an approach to the search for physically grounded solutions of the IPMP using the example of parabolic equations on compact sets of polynomial functions under the conditions of disturbed input data based on parametric optimization implemented using artificial neural networks (ANN). The solution to the problem is obtained on the basis of a combination of an accurate analytical approach, which takes into account information about the physical characteristics of processes and systems with distributed parameters, and intelligent technologies that allow finding the quasioptimal solution under conditions of uncertainty in the mathematical description of the process.
The proposed approach allows us to find solutions to inverse problems without the use of laborious numerical regularizing algorithms that depend on factors that are difficult to formalize on a compact set of smooth functions, taking into account the measurement noise acting over a sufficiently wide range, with an accuracy acceptable for practical applications. Difficulties associated with the need to process a large amount of input information affect the training of an artificial neural network, and practically do not affect its performance when it is subsequently used to solve a specific problem of identifying the boundary conditions of the process.

Formulation of the problem
We consider a linear one-dimensional homogeneous partial differential equation of parabolic type, given in relative coordinates: supplemented by initial and boundary conditions of the second kind: The formulation of the inverse problem provides for the presence of input information * ( = ( * , , , where in most real cases the value of the state function is used -temperature ( , , -obtained as a result of its control (measurements) at some fixed point * ∈ [0,1] at discrete moments in the identification interval ∈ [0: ℎ: * and containing measurement errors . In the inverse boundary problem, it is required to determine the unknown time-dependent heat flux density ( , applied to the outer boundary = 1, with the remaining parameters and characteristics of the object given.
As a rule, a modern approach to the formulation of inverse problems is their definition in a variational formulation, which provides for the minimization of the objective functional in the space of possible solutions [12]. As a measure of the correspondence of the mathematical model to the real process, the value of the temperature residual is used, written in a quadratic or uniform metric [12]- [14]. Then the inverse problem is considered as an optimal control problem in which the conditions for the extremum of the formulated target functional of the temperature residual are investigated [14].
In this paper the inverse problem is formulated in a variational setting as an optimal control problem, where, based on the experimental data obtained under the conditions of disturbances, it is necessary to restore the unknown characteristic ( = ( , minimizing the deviation = * ( )-( * , ) between the experimental results * ( ) and the values of the state function ( * , ), calculated on the basis of the mathematical model (Eq. (1)-(2)) when using found solution ( ) on a given identification interval at the same point * . To estimate the deviation of the model temperature from the experimental one, a functional based on the squared error is used: where the function to be identified ( ) is considered as the desired control and is subject to the conditions of belonging to the corresponding set . Quadratic error functional Eq. (3) is chosen as the most widespread in neural network technologies, which are used further in solving the problem of parametric optimization.

Parametric optimization of the desired characteristic
To solve the formulated problem (Eq. (3)), a transition is made from the original set to the class of functions physically substantiated in the process of identifying functions that form a compact set. As physically realizable characteristics specified on the basis of requirements for their smoothness, we consider a set of polynomial functions of the form: where the exact value ensures that the identified characteristic belongs to a specific class of functions. Thus, the value and the corresponding vector of parameters Δ = ( , , … , ) uniquely determine the parametric representation according to Eq. (4) of the sought-for heat flux density ( ) = ( , ∆).
Then the mathematical description of the process under study (Eq. (1)-(2)) makes it possible to obtain the calculated value of the state function ( , ) = ( , , Δ) as a reaction to the boundary effect ( , Δ) , expressed in parametric form, at given values and Δ , which corresponds to the temperature parameterization procedure. The resulting representation ( , , ∆) leads to the parametric optimization problem: with respect to the desired vector of parameters Δ. Thus, the narrowing of the original class of solutions to a compact set of polynomial functions according to Eq. (4) given by the number and the corresponding vector Δ, allows us to formulate the parametric optimization problem given in a form of Eq. (5), and thus corresponds to the transition from the original ill-posed problem to the conditionally correct formulation, which solution does not require the use of regularization methods.
Proposed approach to identifying an unknown function ( ) is based on constructing a sequence of functions on a compact set , Δ ( ) , that minimizes the quadratic deviation with increasing number and, thus, converges to the exact solution ( ). Based on the Weierstrass theorem [15], the solutions obtained are regular. Each successive approximation of the sequence can be considered as an intermediate solution, and the computational procedure can be stopped when the deviation of the calculated value ( * , , ∆) from the measured one * ( ) meets the requirements of a given accuracy. At a low level of perturbations, the solution to the problem can be realized using the minimax optimization method [8]- [11], based on the analytical optimality conditions [16]. In a situation where the input data is significantly distorted by measurement errors, it is proposed to solve the problem using artificial intelligence methods that allow processing large data arrays to find vector values Δ, that ensure the fulfillment of the quadratic optimality criterion Eq. (5).

Construction of neural networks for solving inverse problems of mathematical physics
There are no general solution methods that allow one to find the global extremum of functional Eq. (5) under the conditions of the action of perturbations. When using input data * ( , ), that take into account measurement errors , the method of sequential parameterization [8]- [11], which is successfully used to find solutions to inverse problems of heat conduction under deterministic influences, is proposed to be supplemented with the use of ANN. Neural networks are profitably applied to solve problems of approximating time series, constructing dynamic dependencies, predicting the values of functions at future moments in time related to direct problems [17]- [19]. By choosing the type of neural network, the number of layers and neurons in each of the layers, setting the activation function and the network learning algorithm, the behavior of the state function is reproduced with a sufficient degree of accuracy. To search for solutions to problems in mathematical physics, it is recommended to use such neural networks as multilayer perceptron, networks with radial basis functions, probabilistic networks, generalized regression networks [20], [21]. Neural network technologies can also be used to solve inverse problems [22]- [24].
The formulated parametric optimization problem (Eq. (5)) is considered under conditions of interval uncertainties, when the amount of a priori information about the values of the parameters − is limited by information about the boundaries of the interval of their possible change: A set of possible combinations of parameters , = 0, forms a ensemble of temperature curves ( * , , Δ), Δ = ( , , … ), that satisfy the conditions (Eq. (6)). Then the problem (Eq. (5)) is considered with respect to a set of temperature realizations that satisfy all possible combinations of parameter values , = 0, . To solve this problem, neural networks are used that allow processing large data arrays containing possible values of the parameters of the identified characteristic and the corresponding realizations of the temperature field.
Solution to the problem (Eq. (5)) based on noisy input data * ( , ) is reduced to a step-bystep search for the values of the parameter vector Δ ( ) = ( , , … , ) for increasing values = 1,2, … , * . The iterative procedure ends at = * , when the solution obtained at the next step Δ ( ) ensures the achievement of an absolute * , , ∆ ( ) − * ( ) ≤ or relative * , , ∆ ( ) − * , , ∆ ( ) ≤ accuracy. At each iteration, for a chosen number and a given, thus, the structure of the vector Δ ( ) , the problem of parametric optimization (Eq. (5)) taking into account the perturbed input data * ( , ) is reduced to the execution of the following algorithm. The ANN constructed in this way is used further to calculate on the basis of noisy experimental data * ( , ), obtained at the temperature control point * ∈ [0, 1] in the identification interval ∈ [ , , … ; = 0, = * the parameter values = ( , , … , ) = ∆ , providing the best coincidence of the calculated data and measurement results according to the criterion of the minimum squared error. The obtained solution to the parametric optimization problem (Eq. (5)), corresponding to the conditionally correct formulation of the inverse heat conductivity problem, belongs to a compact set of functions of a given form Eq. (4) and is stable, regardless of the input data error. The magnitude of the error only affects the accuracy of the reconstruction of the identified characteristic. The block diagram reflecting the procedure for solving the inverse problem of technological thermophysics is shown in Fig. 1. The formulated parametric optimization problem (Eq. (5)) was solved using radial basis function network (RBFN) [20], [21], which showed efficiency in solving direct problems of mathematical physics. These structures contain an inner layer consisting of radial elements that implement the Gaussian function, and a linear layer that provides a weighted average estimate. The weighting factors are obtained by minimizing the distance between the calculated values ( * , , Δ ), corresponding to the found vector of parameters Δ and the corresponding realizations of the input data array * , , Δ . A linear combination of the output signals of the radial elements for all elements of the training sample, with the found weight coefficients, makes it possible to obtain the resulting estimate of the values of the parameters of the polynomial representation according to Eq. (4) of the identified characteristic ( ). A diagram showing the architecture of a radial basic neural network for solving a parametric optimization problem is shown in Fig. 2.

Results and discussion
According to the described method, on the basis of the mathematical model (Eq. (1), (2)), the inverse boundary problem of heat conduction was solved by restoring the unknown function of the heat flux density: using experimental data * ( , ) taking into account the additive measurement error * ( , ) = ( * , ) + , where ( * , ) -exact solution of the heat conduction problem (Eq. (1), (2)), and "randn" function simulates a normal distribution with zero mean value and standard deviation .
Temperature dependence ( * , ) was obtained at the point * = 0.9 based on the general solution of the heat problem, expressed in integral form: where ( , , -) -Green's function corresponding to the boundary value problem (Eq. (1), (2)).
Some results of solving the problem are presented in Figs. 3-6.
The figures show the change in the configuration of the temperature discrepancy with an increase in the intensity of the interference when searching for solutions in the class of functions = 3. With no interference ( Fig. 3(a)) alternating extrema are present on the curve ( * , )- * , , Δ ( ) , and the error in approximating the temperature field is less than 1 %. With an increase in the level of measurement error, the curve of the temperature residual is distorted JOURNAL OF VIBROENGINEERING. SEPTEMBER 2021, VOLUME 23, ISSUE 6 ( Fig. 3(b)), which leads to an increase in the approximation error. A similar situation is when = 2 and = 3 (Fig. 4, 5). In the general case, the solution in the class of functions with the number = 3 allows us to obtain greater accuracy than with = 2 both for approximating the temperature (Fig. 4(a), 5(a)) and for identifying the unknown function -the heat flux density (Fig. 4(b), 5(b)), but in each case the results based on the analysis of random processes using neural networks may differ. At the same time, there is no unambiguous relationship between the error ( * , )- * , , Δ ( ) and ( )-, Δ ( ) as in most cases, this happens when using deterministic algorithms [8]- [11]. With an increase in the level of perturbation, the configuration of the temperature field error changes, which leads to a decrease in the accuracy of the temperature approximation and the identified function. This dependence has an ambiguous character for the restoration of both the state function and the desired characteristic. Artificial intelligence methods ensure the accuracy of solving the problem, acceptable for engineering calculations (Fig. 6), in the selected range of measurement error with a given input information.

Conclusions
In this paper, using the example of the boundary value inverse problem of heat conduction, an approach to solving inverse problems of mathematical physics is presented, which combines the advantages of the exact analytical method, which is the basis for the identification of objects with distributed parameters on a compact set of polynomial functions, and artificial intelligence methods that allow processing large amounts of data and used for solving the problem of parametric optimization in conditions of perturbation of input information. The results obtained confirm the possibility of using neural networks in solving the problem of parametric optimization using the example of the inverse heat conductivity problem. The effectiveness of the results obtained depends on the level of measurement error and the specified values of the boundaries of the intervals of the probable change in the parameters.
To improve the accuracy of the solution, it is necessary to increase the degree of the approximating polynomial and, accordingly, the dimension of the sought vector of parameters Δ( ), each of which , = 0, under data uncertainty is set on a certain admissible interval. With an increase of the number , the complexity and cumbersomeness of the neural network rapidly occurs. Moreover, some a priori information about the technological limitations of the device or process under study must be known for the adequate parameter setting.
The computational complexity of the proposed approach is associated with a large volume of processed data with an increase in the number of estimated parameters, which requires significant computing resources and time. These requirements are necessary only at the stage of training the neural network. The trained neural network is versatile and can be used repeatedly in the study of typical heat conduction processes.