Stochastic processes, prediction of

extrapolation of stochastic processes

The problem of estimating the values of a stochastic process $ X ( t) $ in the future $ t > s $ from its observed values up to the current moment of time $ s $. Usually one has in mind the extrapolation estimator $ \widehat{X} ( t) $, $ t > s $, for which the mean-square error $ {\mathsf E} | \widehat{X} ( t) - X ( t) | ^ {2} $ is minimal over all estimators based on the past values of the process up to the moment $ s $( the prediction is called linear if one restricts consideration to linear estimators).

One of the problems posed and solved was that of linear prediction of a stationary sequence. This problem is analogous to the following: In the space $ L _ {2} $ of square-integrable functions on the interval $ - \pi \leq \lambda \leq \pi $ one has to find the projection of the function $ \phi ( \lambda ) \in L _ {2} $ onto the subspace generated by the functions $ e ^ {i \lambda k } \phi ( \lambda ) $, $ k = 0 , - 1 , - 2 ,\dots $. This problem has been greatly generalized in the theory of stationary stochastic processes (cf. Stationary stochastic process). One application is the problem of predicting stochastic processes arising from the system

$$ L X ( t) = Y ( t) ,\ t > t _ {0} , $$

where $ L $ is a linear differential operator of order $ l $ and $ Y ( t) $, $ t > t _ {0} $, is a white noise process. The optimal prediction $ \widehat{X} ( t) $, $ t > s $, given the values of $ X ( t) $ at the times $ t _ {0} \leq t \leq s $ and the initial values $ X ^ {(} k) ( t _ {0} ) $, $ k = 1 \dots l - 1 $, independent of white noise, is obtained by solving the corresponding equation

$$ L \widehat{X} ( t) = 0 ,\ t > s , $$

with initial conditions

$$ \widehat{X} {} ^ {(} k) ( s) = X ^ {(} k) ( s) ,\ \ k = 0 , l - 1 . $$

For systems of stochastic differential equations, the problem of predicting some components given the values of other observed components reduces to the extrapolation of the corresponding stochastic equations.

For references see Stochastic processes, interpolation of.

Comments[edit]

Study of the linear prediction problem was initiated by A.N. Kolmogorov in Russia [a7], [a8], and in the West by N. Wiener [a6], who also, with P. Masani, treated the multivariate case [a11], [a12]. They considered prediction based on the entire past; prediction based on a finite segment of the past is more subtle, see [a9], [a10]. Linear prediction for non-stationary processes is covered in [a13]. The linear theory may also be found in [a2]. The approach of R.E. Kalman [a3], [a4] has produced practically usable prediction algorithms, based on the Kalman filter and on state space realizations of the underlying processes. A generalization of the prediction problem to diffusion processes is presented in [a5]. For applications of prediction algorithms in the applied sciences see [a1].

References[edit]