Published: 26 September 2017

Nonlinear signal processing in systems with random structure for the case of spatial-time-varying colored Gaussian-Markov noise

Tatiana P. Kolosovskaya1
1Moscow Aviation Institute (National Research University), Moscow, Russia
Views 17
Reads 3
Downloads 1334


The extension of the adaptive estimation theory for nonlinear correlation-extremum systems with random structure to the case when the measurements noise model is a spatial-time-varying Gaussian-Markov colored process is presented and the new signal processing algorithms are derived which provide the system operation in varying and uncertain external conditions.

1. Introduction

A common practice of much of the work in the area of signal processing in the stochastic dynamic systems carried out in the past has been associated with the state dynamics and measurements modelling with nonlinear (sometimes extremely) functions of the state variables and with corresponding digital filtering algorithms. One of the widely used estimation algorithms in terrestrial and magnetic field navigation systems, in most of the target tracking systems, and in the other areas of applications up to now is an extended Kalman filter (EKF), which performs only relatively robust under operating conditions adequately described in the state and the measurement models, and under natural or artificial disturbances such as abrupt increasing of the measurements noise, informative signal interruption, discontinuous jump of the estimated process features (the last may occur as a result of abrupt target maneuvers), and etc., the behavior of EKF becomes undamped and often ends in diverge.

The causes of the Kalman filter diverge have been first analyzed by Kalman R. E. [1] and Knoll A. [2] and generalized by Sage A. P. and Melse J. L. in [3].

The asymptotic properties of different estimators as a complicated problem is still an open area for further researches.

In most practical applications of filtering theory, the uncertain measurements noise models are sometimes represented by Gaussian processes with unknown probabilistic characteristics (one of the causes of a filter diverge), and the variations of these characteristics and their identification in different conditions play an important role to ensure the stochastic dynamic systems reliability and operation under environment influences. It is specifically necessary to avoid the often-used concept of adding considerable dynamics pseudo-noise to open the filter bandwidth since this tends to veil the differences between the real and the inadequately described models.

An adaptive Kalman filtering algorithm for the standard linear problem under an irregular environment where all variances of zero-mean Gaussian white (system and observation) noises are unknown a priori is obtained in [4] with the modified Kalman gain matrix, which is considered as its “optimal estimate” that depends only on the given data. In [5] an EKF, implemented in radar coordinates, includes together the features based on the introducing model noise into the state estimate covariance matrix before propagation (to increase the robustness of the filter by appropriately distributing the model noise based on the observed trajectory and filter update interval), and on using both static and dynamic model noise terms where the last are adjusted according to the observed track errors and cause the filter to weight new measurements more.

Another limitation of the Kalman filtering schemes (linear or suboptimal extended one) is in the fact that they can process only time-varying signal functions.

One of the earlier approaches to process the spatial-time-varying signals such as two-dimensional infra-red target images by means of a Kalman filter enhanced by a correlator was proposed in [6].

A further difficulty in the nonlinear signal processing may occur when the measurements models contain colored noises as the covariance matrix is positively semi-definite that has an adverse effect on the filter gain computations.

Some previous work has already dealt with the linear filtering problem for time-varying systems using measurements containing colored time-varying noise, since one of the first researches [7]. The spatial-time-varying filtering problem in the additive spatial-time-varying colored noise has been investigated in [8]. All of these researches refer only to state estimation in the classical stochastic dynamic systems (SDS) with deterministic structure.

Thus, a theoretical investigation was necessary to describe more adequately the SDS and the environment influences on the system to ensure the SDS robustness and operation in different conditions (for example, a tracking system convergence after a target maneuver has occurred).

In [9-11] the correlation-extremum methods were originally applied to signal processing for the systems with random structure and the nonlinear estimation algorithms using spatial-time-varying signals in spatial-time-varying Gaussian white noise (STVGWN) were derived.

In this research, the new estimation algorithms have been derived using a spatial-time-varying measurements model with the spatial-time-varying Gaussian-Markov colored noise (STVGMCN) in conjunction with both nonlinear correlation-extremum system and system with random structure.

1.1. Problem under consideration

Consider the following nonlinear estimation problem for the dynamic state process described by a stochastic differential equation (Eq. (1)) [9]:

Λ˙t= FlΛ,u, t+ Wlt, Λ(t0) = Λ0, ( l = 1, p¯),

where Λ(t) is the n-dimensional, in general case, state vector, which contains the random, unknown, and time-varying parameters vector aT=(a1, ,aq), with initial Gaussian value Λ(t0), F(l)(Λ,u, t) is the nonlinear deterministic vector function FlΛ,u, t=fi(l)(Λ,u, t), (i= 1,n¯) which satisfies Lipschitz conditions, u(t) is the known control vector, which may depends on the state vector estimates components, l(t) is a stationary Markov process taking values in the set {1, 2,..., p} (number of the state). Here Wlt is a vector process of the state Gaussian white noise with diagonal intensity matrix Qlt=qi(l)(t), (i= 1,n¯).

The following measurement Eq. (2):

rx, y, t= Slx, y, Λ,t+ ηlx, y, t, l = 1, p¯,

describes the observable signal rx, y, t as the m-dimensional spatial-time-varying process, where x, y are the space variables – space coordinates at any point – xX = [ x0,xX ], y Y = [ y0,yY ], t is the time variable tT=[ t0,tT ], Slx, y, Λ,t is the vector of spatial-time-varying signals of different physical nature, ηlx, y, t is the vector process of STVGMCN type.

The spatial-time-varying signal position on the image plane XOY can be determined by parameters vector λxt=φx(Λ,t), λyt=φy(Λ,t). Then the signal may be written as Slx, y, Λ,t=Slx-λx, y-λy,t.

The changes of the structure are assumed to be Markov process with p-finite states and the transition intensities νjlt and νjt, where j, l= 1,p¯. The behavior of the system with random structure may be explicated by the example of a tracking system in the cases of a maneuvering target tracking interruption or of great estimation errors, when the target remains in each state for a random period of time, and the Markov process models describe the stochastic continuous process of target dynamics and digital process of the structure changes.

Given the nonlinear estimation problem defined above for Eq. (1-2), we would like to find the finite-dimensional dynamical system whose output is the best minimum variance estimate of the joint Markov process (Λ(t), l(t))T, for t0, where the suboptimal estimate Λ^(t) of Markov process Λ(t) is the conditional mathematical expectation, and the optimal estimate of discrete process l(t) by the a posteriori probability criterion will be such a value of l that makes the value of the a posteriori probability P^lt maximum (the sign ^ means the a posteriori function value).

1.2. Solution of the algorithms synthesis and analysis problem

The solution of the spatial-time-varying signal processing algorithms synthesis and analysis problem presented in this paper is based on a combination of two theories – the correlation-extremum systems theory and the theory of stochastic systems with random structure.

The algorithms synthesis for correlation-extremum systems with random structure [9-11] was based on the generalized Fokker-Plank-Kolmogorov-Stratonovich equation for the evolution of joint conditional probability density function of the state dynamics Λ(t) and the system structure l(t) given the observed spatial-time-varying data rx, y, tωΛ, l ,t |rx, y, τ, t0 τt =ω^Λ, l ,t= ω^lΛ, t (Eq. (3)):

ω^lΛ,tt=- div π^lΛ,t
- 12ω^lΛ,t ΦlΛ,r,t--Φlz,r,tω^lz,tdz
+j=1jlpνjltP^j tP^l t ω^jΛ,t-ω^lΛ,t, ωΛ0, t0, l=1,p¯,

where P^lt is the a posteriori probability of the lth state, Φ(l)(Λ,r,t) is the derivative of the likelihood function logarithm in the lth state (z is the variable, zΛ), π^lΛ,t is the probability density flow vector in the lth state:

π^lΛ,t=K1lΛ,tω^lΛ,t- 12div K2lΛ,t ω^lΛ,t ,

where K1lΛ,t is the local rate vector, K2lΛ,t is the diffusion matrix, ωΛ0, t0 is the initial value of probability density of the state dynamics Λ(t0).

The a posteriori probability density for the whole dynamics process is defined by the following expression ω^(Λ,t)=l=1pP^l tω^lΛ,t. The suboptimal estimate of the state is the probabilistically weighted average Λ^(t)=l=1pP^l tΛ^lt.

The presence of the state probability estimate equations (Eq. (4)) (differential or discrete (for a discrete problem statement)) in the estimation algorithms and the relation between these equations are the main distinctive characteristics of signal processing in systems with the random structure [9, 10]:

dP^ltdt=- νltP^lt+j=1jlpνjltP^j t
+ 12 P^lt-Φlz,r,tω^lz,tdz - k=1pP^k t-Φkz,r,tω^kz,tdz .

The a priori state probabilities Pl(t) are determined according to Kolmogorov equations:

dPltdt=- νltPlt+j=1jlpνjltPj t.

In this research, the principle of the likelihood function maximum for the STVGMCN ηx, y, t is first extended to the systems with random structure.

The solution of the problem in this paper has been obtained in Gaussian approximation of the a posteriori probability density. In the algorithms synthesis, to simplify the derivation, it was supposed that the signal or image position along one of the axes (e.g., in y direction) was known denoting the signal Slx, Λ,t=Slx-λx,t, and the state parameter λx without index λx = λ. Then the measurement equation (Eq. (2)) takes the form: rx, t= Slx-λx,t+ ηlx, t, ( l = 1, p¯).

The spatial-time first-order filters (shaping filters) with the transfer function Hq,p,(H1q, q=/x,H2p,p=/t) are used to transform the STVGWN Nlx, t with spectral densities C0(l) in the case of stationary measurements noise (and may be C0l(t), in the case of nonstationary noise) to the Gaussian-Markov colored spatial-varying and time-varying noises, correspondingly: ηlx,t=Nlx, tHq,p, where ηlx,t is the exponentially correlated process (STVGMCN) with spatial-time correlation function BηlΔx, Δt=B0lexp-αΔx-βΔt, B0l=C0lαβ/2, and frequency characteristics: GUx=α2/(Ux2+α2); Gω=β2/(ω2+β2); where Ux and ω are the spatial and temporal frequencies, the values 𝛼 and β determine the spatial and temporal correlation intervals;

ηlx,t= ηlx,ts ηlxk ,tT= Nlx, tsH1q Nlxk ,tH2pT, where the components ηlx,ts and ηlxk ,t are formed in the cuts of the ηlx,t process by orthogonal planes for t=ts and x=xk, (k,s=1,M¯) assuming the spatial and time processes regenerations (or transformations) to be independent.

The STVGMCN model is represented by two components of the time-varying ηlxk,t and spatial-varying ηlx,ts narrowband background described by the Langevin first order differential equations (Eq. (5)), first written for the systems with random structure:

ηlx,tsx=-α ηlx,ts+Nlx, ts,
ηlxk ,tt=-β ηlxk ,t+Nlxk ,t, k,s= 1,M¯ .

For the case when the structure changes represent Markov process with two states (l= 1, 2) and the transition intensity ν(t) the new solution of nonlinear filtering problem in STVGMCN for systems with random structure has been obtained in the form of the following correlation-extremum algorithms for computing the a posteriori probabilities of state (Eq. (6)), the state estimates (Eq. (7)), and the covariance (Eq. (8)).

The differential equation for the a posteriori probabilities of state is presented below:

d P^1 tdt =-ν-1- P^1 t 2CX12 k1+B1Δλ1- 1α2Bx1Δλ1+kx1
- 1β2Bt1Δλ1+kt1-2 2B1Δλ1Δλ12+1α2 2Bx1Δλ1Δλ12
+1β22Bt1Δλ1Δλ12σ12t+ nx1+nt1P^1 t
+ν- P^1 t 2CX22 k2+B2Δλ2- 1α2Bx2Δλ2+kx2
- 1β2Bt2Δλ2+kt2-2 2B2Δλ2Δλ22+1α2 2Bx2Δλ2Δλ22
+1β22Bt2Δλ2Δλ22σ22t+nx2+nt21-P^1 t,
P^2t=1- P^1 t,

where P^2 t is the a posteriori probability of the second state, Δλlt is the state estimate error Δλlt=λt-λ^lt, σl2t is the variance of the a posteriori probability density function σl2t=[(λt- λ^lt]2, (l=1,2¯ ); BlΔλl,t is the spatial correlation function in the lth state BlΔλl,t=SlT(x-λ^l,t)Sl(x- λ ,t), (or for the scalar measurement: BlΔλl,t=Sl(x-λ^l,t)Sl(x- λ ,t)),

BtlΔλl=Slx-λ , tt Slx-λ^l, tt, ktl=-XXSlx-λ^l, tt2dx ,
BxlΔλl=Slx-λ , tx Slx-λ^l, tx, kxl=-XXSlx-λ^l, tx2dx ,
nxl= 12C0lα2-XXηlx , tx Slx-λ^l, txdx,
ntl= 12C0lβ2-XXηlx , tt Slx-λ^l, ttdx.

CXl is the specific spectral intensity of the STVGWN Nlx, t in the lth state, CXl=C0l/X.

The equations (Eq. (6)) have been derived using the assumption of the “unpowered” parameters. This assumption means that the integrals -XX[Slx λ^l, t]2dx and -XXr2x , tdx , which represent the signal power and are explicitly independent of the estimate parameter, may be included in the k1 and k2 coefficients, and the integrals of the squared signals derivatives, with respect to t and x, may be involved in the ktl and kxl terms.

The estimates λ^lt and covariances σl2t in each state are combined to obtain the suboptimal (as the system is nonlinear) estimate λ^t and covariance σ2t for the whole process by using a weighted sum, where the weighting factor is the a posteriori probabilities of states P^lt.

Using the obtained derivatives of the likelihood function logarithm with respect to the estimates in each state and some rearrangements, the following state estimate equation (Eq. (7)) has been derived:

dλ^ltdt=flλ^l,u, t-σl2t2CXl2 BlΔλl,tΔλl+1α2 BxlΔλlΔλl
+1β2BtlΔλlΔλl+ σl2tNXαβl+ν P^j t P^l tλ^lt-λ^jt,
λ^lt0=λ^0l, (l,j=1,2¯, jl),


NXαβ(l)= 12C0l λ^l-XX2ηlx , tSlx λ^l, t+ 1αηlx , txSlx λ^l, t
+ηlx , t Slx λ^l, tx+1α2ηlx , tx Slx-λ^l, tx
+1βηlx , tt Slx-λ^l, t+ηlx , t Slx-λ^l, tt
+1β2ηlx , tt Slx-λ^l, ttdx.

(As a remark: in many cases the measurements signals and noises are (or are supposed to be) uncorrelated). In this solution, the spatial-time-varying signals are processed in parallel by two estimators exchanging information between them, each based (for example) upon a particular model of target dynamics intensity and adaptive expansion or contraction of the target tracker field of view attained by generating the probabilistically weighted average of the two filter state estimates.

The variance equation (Eq. (8)) is presented below:

dσl2tdt=2 σl2t fl λ^l,u, t λ^l+ σl4t2CXl22BlΔλlΔλl2+1α2 2BXlΔλlΔλl2
+1β22BtlΔλlΔλl2+σl4tNαβl*+qlt+ν P^jt P^ltσJ2t-σl2t
+ λ^jt-λ^lt2, σl2t0 , l,j=1,2¯, jl,
σ2t=P^1 t σ12t+P^2 t σ22t,


Nαβl*=1C0l 2(λ^l)2-XX1αηlx , txSlx λ^l, t+ηlx , t Slx-λ^l, tx
+1α2ηlx , tx Slx-λ^l, tx+1βηlx , tt Slx-λ^l, t
+ηlx , t Slx-λ^l, tt+1β2ηlx , tt Slx-λ^l, ttdx.

The variance equations (Eq. (8)) are the new Riccati-type differential equations derived 1) for systems with random structure 2) with cross correlation functions (their second derivatives) 3) for signal processing in STVGMCN.

The filtering algorithm for correlation-extremum systems with random structure for estimation of signal position along the y axis has been derived, similarly, and for both components of the state vector λxt and λyt the appropriated adaptive estimation algorithm has been derived.

Signal processing in the presence of the STVGMCN is a more general form of the estimation problem, which allows one 1) to obtain the solution for the measurement STVGWN [9, 10], modifying the equations (Eqs. (6-8)), considering α, β, and in this fashion maximizing the corresponding bandwidths, and 2) to receive the background model reflecting the real environmental conditions more adequately by changing the parameters of the STVGMCN α and β.

Using the proposed algorithms based on the systems with random structure theory there is no need in experimental or artificial tuning the gain matrix to avoid diverge as it was necessary for nonlinear filters in systems with a deterministic structure.

The obtained linearized solution of the derived algorithms allows to receive the a priori performance evaluation of the signal processing system in different conditions.

It can also be noticed that the new algorithms take advantages of recent increases in processor speeds satisfying the required computational burdens, and of the correlation-extremum signal processing properties.

2. Conclusions

The proposed new correlation-extremum algorithms for computing the a posteriori probabilities of states, the state estimates, and the variance, are obtained using the theory of Markov processes and stochastic systems with random structure for the adaptive estimation problem, when the state and the parameter models follow Markov processes, and the measurements are the nonlinear spatial-time-varying signals of different physical nature where the measurements noise is the spatial-time-varying Gaussian-Markov colored process first considered as a measurement noise model in systems with random structure to describe more adequately the environmental influences on SDS.

The proposed extension of the correlation-extremum methods to the theory of Markov processes and systems with random structure provides adaptive features for the combined system by generating the probabilistically weighted average of the state estimates, with the gain first as an analytical function (not as an experimentally or artificially modified value) depending on the spatial cross-correlation function derivatives and the a posteriori probabilities of states, and assures the complex SDS with random structure reliability and operation in varying and uncertain external conditions.

There are many potential military and civil application areas of the derived nonlinear spatial-time-varying signal processing algorithms, in particular in such nonlinear SDS as tracking, navigation systems, robotics equipped with image sensors (e.g., radar, optics, and etc.) using the spatial-time-varying measurements information of different nature fields.


  • Kalman R. E. A new approach to linear filtering and prediction problems. Transactions on ASME, Journal of Basic Engineering, Vol. 82, 1960, p. 34-45.
  • Knoll A., Edelstein M. Estimation of local vertical and orbital parameters for an Earth satellite using horizon sensor measurements. AIAA Journal, Vol. 3, Issue 2, 1965, p. 338-345.
  • Sage A. P., Melse J. L. Estimation Theory with Applications to Communication and Control. New-York, McGraw-Hill, 1976, (in Russian).
  • Chen Guanrong, Chui Charles K. A modified adaptive Kalman filter for real-time applications. IEEE Transactions on Aerospace and Electronic Systems, Vol. 27, Issue 1, 1991, p. 149-153.
  • Cardillo G. P., Mrstic A. V., Plambeck T. A track filter for reentry objects with uncertain drag. IEEE Transactions on Aerospace and Electronic Systems, Vol. 35, Issue 2, 1999, p. 394-408.
  • Maybeck P. S., SuizuR. I. Adaptive tracker field-of-view variation via multiple model filtering. IEEE Transactions on Aerospace and Electronic Systems, Vol. 21, Issue 4, 1985, p. 529-538.
  • Bryson A. E., Johansen D. E. Linear filtering for time-varying systems using measurements containing colored noise. IEEE Transactions on Automatic Control, Vol. 10, 1965, p. 4-10.
  • Baklitski V., Yuriev A. Correlation-Extremum Methods in Navigation. Radio and Communication, Moscow, 1982, (in Russian).
  • Kolosovskaya T. Spatial-time-varying signals processing algorithms in systems with random structure. Mechanical Engineering and Machine Reliability Problems, Vol. 5, 1995, p. 105-112, (in Russian).
  • Kolosovskaya T. Nonlinear filtering and identification algorithms for correlation-extremum dynamic systems with random structure. Journal of Vibroengineering, Vol. 8, 2016, p. 531-537.
  • Kolosovskaya T. Adaptive estimation using linearized spatial-time-varying signal processing algorithms in systems with random structure. 15th International Conference on Aviation and Cosmonautics, Moscow, 2016, p. 450-452.

About this article

06 September 2017
07 September 2017
26 September 2017
Mathematical models in engineering
signal processing
Markov processes
spatial-time-varying colored noise
correlation-extremum methods
optimization of stochastic systems with random structure

The author would like to thank the mentioned authors [1-8], whose input researches generate the further output investigations as an innovative process.