Covariance and correlation

Short description: Concepts in probability and statistics

Part of a series on Statistics

Correlation and covariance

Correlation and covariance of random vectors

* Autocorrelation matrix

* Cross-correlation matrix

* Auto-covariance matrix

* Cross-covariance matrix

Correlation and covariance of stochastic processes

* Autocorrelation function

* Cross-correlation function

* Autocovariance function

* Cross-covariance function

Correlation and covariance of deterministic signals

* Autocorrelation function

* Cross-correlation function

* Autocovariance function

* Cross-covariance function

* v
* t
* e

In probability theory and statistics, the mathematical concepts of covariance and correlation are very similar.[1][2] Both describe the degree to which two random variables or sets of random variables tend to deviate from their expected values in similar ways.

If X and Y are two random variables, with means (expected values) μX and μY and standard deviations σX and σY, respectively, then their covariance and correlation are as follows:

covariance
covXY=σXY=E[(X−μX)(Y−μY)]
correlation
corrXY=ρXY=E[(X−μX)(Y−μY)]/(σXσY),

so that ρXY=σXY/(σXσY)

where E is the expected value operator. Notably, correlation is dimensionless while covariance is in units obtained by multiplying the units of the two variables.

If Y always takes on the same values as X, we have the covariance of a variable with itself (i.e. σXX), which is called the variance and is more commonly denoted as σX2, the square of the standard deviation. The correlation of a variable with itself is always 1 (except in the degenerate case where the two variances are zero because X always takes on the same single value, in which case the correlation does not exist since its computation would involve division by 0). More generally, the correlation between two variables is 1 (or –1) if one of them always takes on a value that is given exactly by a linear function of the other with respectively a positive (or negative) slope.

Although the values of the theoretical covariances and correlations are linked in the above way, the probability distributions of sample estimates of these quantities are not linked in any simple way and they generally need to be treated separately.

## Multiple random variables

With any number of random variables in excess of 1, the variables can be stacked into a random vector whose i th element is the i th random variable. Then the variances and covariances can be placed in a covariance matrix, in which the (i, j) element is the covariance between the i th random variable and the j th one. Likewise, the correlations can be placed in a correlation matrix.

## Time series analysis

In the case of a time series which is stationary in the wide sense, both the means and variances are constant over time (E(Xn+m) = E(Xn) = μX and var(Xn+m) = var(Xn) and likewise for the variable Y). In this case the cross-covariance and cross-correlation are functions of the time difference:

cross-covariance
σXY(m)=E[(Xn−μX)(Yn+m−μY)],
cross-correlation
ρXY(m)=E[(Xn−μX)(Yn+m−μY)]/(σXσY).

If Y is the same variable as X, the above expressions are called the autocovariance and autocorrelation:

autocovariance
σXX(m)=E[(Xn−μX)(Xn+m−μX)],
autocorrelation
ρXX(m)=E[(Xn−μX)(Xn+m−μX)]/(σX2).

## References

1. ↑ Weisstein, Eric W.. "Covariance". http://mathworld.wolfram.com/Covariance.html.
2. ↑ Weisstein, Eric W.. "Statistical Correlation". http://mathworld.wolfram.com/StatisticalCorrelation.html.

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Covariance and correlation. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Covariance_and_correlation&oldid=205774"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template