Probability integral transform

Short description: Probability theory operation

In probability theory, the probability integral transform (also known as universality of the uniform) relates to the result that data values that are modeled as being random variables from any given continuous distribution can be converted to random variables having a standard uniform distribution.[1] This holds exactly provided that the distribution being used is the true distribution of the random variables; if the distribution is one fitted to the data, the result will hold approximately in large samples.

The result is sometimes modified or extended so that the result of the transformation is a standard distribution other than the uniform distribution, such as the exponential distribution.

The transform was introduced by Ronald Fisher in his 1932 edition of the book Statistical Methods for Research Workers.[2]

## Contents

* 1 Applications
* 2 Statement
* 3 Proof
* 4 Examples
* 5 See also
* 6 References

## Applications

One use for the probability integral transform in statistical data analysis is to provide the basis for testing whether a set of observations can reasonably be modelled as arising from a specified distribution. Specifically, the probability integral transform is applied to construct an equivalent set of values, and a test is then made of whether a uniform distribution is appropriate for the constructed dataset. Examples of this are P–P plots and Kolmogorov–Smirnov tests.

A second use for the transformation is in the theory related to copulas which are a means of both defining and working with distributions for statistically dependent multivariate data. Here the problem of defining or manipulating a joint probability distribution for a set of random variables is simplified or reduced in apparent complexity by applying the probability integral transform to each of the components and then working with a joint distribution for which the marginal variables have uniform distributions.

A third use is based on applying the inverse of the probability integral transform to convert random variables from a uniform distribution to have a selected distribution: this is known as inverse transform sampling.

## Statement

Suppose that a random variable X has a continuous distribution for which the cumulative distribution function (CDF) is FX. Then the random variable Y defined as

Y:=FX(X),

has a standard uniform distribution.[1][3]

Equivalently, if μ is the uniform measure on [0,1], the distribution of X on ℝ is the pushforward measure μ∘FX−1.

## Proof

Given any random continuous variable X, define Y=FX(X). Given y∈(0,1), if FX−1(y) exists (i.e., if there exists a unique x such that FX(x)=y), then:

FY(y)=P⁡(Y≤y)=P⁡(FX(X)≤y)=P⁡(X≤FX−1(y))=FX(FX−1(y))=y.

If FX−1(y) does not exist, then the right-continuous inverse FX*(y)=inf⁡{x∈ℝ:FX(x)≥y} is considered instead. It is easy to see thatx≥FX*(y)⟺FX(x)≥y(or equivalently: x<FX*(y)⟺FX(x)<y),(⇒ follows by definition, while ⇐ follows from inf⁡{z∈ℝ:FX(z)≥FX(x)}≥x and the monotonicity of FX). By setting x=FX*(y), one gets FX(FX*(y))≥y.

We now show that it even holds equality. Let (xn)n∈ℕ be a sequence of real numbers with xn<FX*(y) (meaning FX(xn)<y) and limn->∞xn=FX*(y). By the continuity of FX, it then holds FX(FX*(y))=limn->∞FX(xn)≤y as well.

Similarly to the case where the inverse exists, we can conclude

FY(y)=P⁡(FX(X)≤y)=P⁡(FX(X)<y)=P⁡(X<FX*(y))=P⁡(X≤FX*(y))=FX(FX*(y))=y,

using that {FX(X)<y}={X<FX*(y)} and once again that X has a continuous distribution. Thus, FY is just the CDF of a Uniform(0,1) random variable, so that Y has a uniform distribution on the interval (0,1).

## Examples

For a first, illustrative example, let X be a random variable with a standard normal distribution 𝒩(0,1). Then its CDF is

Φ(x)=12π∫−∞xe−t2/2dt=12[1+erf⁡(x2)],x∈ℝ,

where erf⁡(), is the error function. Then the new random variable Y, defined by Y:=Φ(X), is uniformly distributed.

As second example, if X has an exponential distribution with unit mean, then its CDF is

F(x)=1−exp⁡(−x),

and the immediate result of the probability integral transform is that

Y=1−exp⁡(−X)

has a uniform distribution. Moreover, by symmetry of the uniform distribution,

Z=exp⁡(−X)

also has a uniform distribution.

## See also

* Inverse transform sampling
* Cramér distance

## References

1. ↑ 1.0 1.1 Dodge, Y. (2006) The Oxford Dictionary of Statistical Terms, Oxford University Press
2. ↑ David, F. N.; Johnson, N. L. (1948). "The Probability Integral Transformation When Parameters are Estimated from the Sample". Biometrika 35 (1/2): 182. doi:10.2307/2332638. https://www.jstor.org/stable/2332638.
3. ↑ Casella, George; Berger, Roger L. (2002). Statistical Inference (2nd ed.). Theorem 2.1.10, p.54.

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Probability integral transform. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Probability_integral_transform&oldid=4566477"