Radon–Nikodym theorem

Short description: Expressing a measure as an integral of another

In mathematics, the Radon–Nikodym theorem, named after Johann Radon and Otto M. Nikodym, is a result in measure theory that expresses the relationship between two measures defined on the same measurable space. A measure is a set function that assigns a consistent magnitude to the measurable subsets of a measurable space. Examples of a measure include area and volume, where the subsets are sets of points; or the probability of an event, which is a subset of possible outcomes within a wider probability space.

One way to derive a new measure from one already given is to assign a density to each point of the space, then integrate over the measurable subset of interest. This can be expressed as

ν(A)=∫Afdμ,

where ν is the new measure being defined for any measurable subset A and the function f is the density at a given point. The integral is with respect to an existing measure μ, which may often be the canonical Lebesgue measure on the real line ℝ or the n-dimensional Euclidean space ℝn (corresponding to our standard notions of length, area and volume). For example, if f represented mass density and μ was the Lebesgue measure in three-dimensional space ℝ3, then ν(A) would equal the total mass in a spatial region A.

The Radon–Nikodym theorem essentially states that, under certain conditions, any measure ν can be expressed in this way with respect to another measure μ on the same space. The function f is then called the Radon–Nikodym derivative and is denoted by dν/dμ.[1] An important application is in probability theory, leading to the probability density function of a random variable.

The theorem is named after Johann Radon, who proved the theorem for the special case where the underlying space is ℝn in 1913, and for Otto Nikodym who proved the general case in 1930.Cite error: Closing `</ref>` missing for `<ref>` tag

## Contents

* 1 Properties
* 2 Applications
* 2.1 Probability theory
* 2.2 Financial mathematics
* 2.3 Information divergences
* 3 The assumption of σ-finiteness
* 3.1 Negative example
* 3.2 Positive result
* 4 Proof
* 4.1 For finite measures
* 4.2 For σ-finite positive measures
* 4.3 For signed and complex measures
* 5 The Lebesgue decomposition theorem
* 6 See also
* 7 Notes
* 8 References

## Properties

* Let ν, μ, and λ be σ-finite measures on the same measurable space. If ν ≪ λ and μ ≪ λ (ν and μ are both absolutely continuous with respect to λ), then d(ν+μ)dλ=dνdλ+dμdλλ-almost everywhere.
* If ν ≪ μ ≪ λ, then dνdλ=dνdμdμdλλ-almost everywhere.
* In particular, if μ ≪ ν and ν ≪ μ, then dμdν=(dνdμ)−1ν-almost everywhere.
* If μ ≪ λ and g is a μ-integrable function, then ∫Xgdμ=∫Xgdμdλdλ.
* If ν is a finite signed or complex measure, then d|ν|dμ=|dνdμ|.

## Applications

### Probability theory

The theorem is very important in extending the ideas of probability theory from probability masses and probability densities defined over real numbers to probability measures defined over arbitrary sets. It tells if and how it is possible to change from one probability measure to another. Specifically, the probability density function of a random variable is the Radon–Nikodym derivative of the induced measure with respect to some base measure (usually the Lebesgue measure for continuous random variables).

For example, it can be used to prove the existence of conditional expectation for probability measures. The latter itself is a key concept in probability theory, as conditional probability is just a special case of it.

### Financial mathematics

Amongst other fields, financial mathematics uses the theorem extensively, in particular via the Girsanov theorem. Such changes of probability measure are the cornerstone of the rational pricing of derivatives and are used for converting actual probabilities into those of the risk neutral probabilities.

### Information divergences

If μ and ν are measures over X, and μ ≪ ν

* The Kullback–Leibler divergence from ν to μ is defined to be DKL(μ∥ν)=∫Xlog⁡(dμdν)dμ.
* For α > 0, α ≠ 1 the Rényi divergence of order α from ν to μ is defined to be Dα(μ∥ν)=1α−1log⁡(∫X(dμdν)α−1dμ).

## The assumption of σ-finiteness

The Radon–Nikodym theorem above makes the assumption that the measure μ with respect to which one computes the rate of change of ν is σ-finite.

### Negative example

Here is an example when μ is not σ-finite and the Radon–Nikodym theorem fails to hold.

Consider the Borel σ-algebra on the real line. Let the counting measure, μ, of a Borel set A be defined as the number of elements of A if A is finite, and ∞ otherwise. One can check that μ is indeed a measure. It is not σ-finite, as not every Borel set is at most the union of countably many finite sets. Let ν be the usual Lebesgue measure on this Borel algebra. Then, ν is absolutely continuous with respect to μ, since for a set A one has μ(A) = 0 only if A is the empty set, and then ν(A) is also zero.

Assume that the Radon–Nikodym theorem holds, that is, for some measurable function f one has

ν(A)=∫Afdμ

for all Borel sets. Taking A to be a singleton set, A = {a}, and using the above equality, one finds

0=f(a)

for all real numbers a. This implies that the function  f , and therefore the Lebesgue measure ν, is zero, which is a contradiction.

### Positive result

Assuming ν≪μ, the Radon–Nikodym theorem also holds if μ is localizable and ν is accessible with respect to μ,[2]: p. 189, Exercise 9O i.e., ν(A)=sup⁡{ν(B):B∈𝒫(A)∩μpre(ℝ≥0)} for all A∈Σ.[3]: Theorem 1.111 (Radon–Nikodym, II) [2]: p. 190, Exercise 9T(ii)

## Proof

This section gives a measure-theoretic proof of the theorem. There is also a functional-analytic proof, using Hilbert space methods, that was first given by von Neumann.

For finite measures μ and ν, the idea is to consider functions  f with f dμ ≤ dν. The supremum of all such functions, along with the monotone convergence theorem, then furnishes the Radon–Nikodym derivative. The fact that the remaining part of μ is singular with respect to ν follows from a technical fact about finite measures. Once the result is established for finite measures, extending to σ-finite, signed, and complex measures can be done naturally. The details are given below.

### For finite measures

Constructing an extended-valued candidate First, suppose μ and ν are both finite-valued nonnegative measures. Let F be the set of those extended-value measurable functions f : X → [0, ∞] such that:

∀A∈Σ:∫Afdμ≤ν(A)

F ≠ ∅, since it contains at least the zero function. Now let f1, f2 ∈ F, and suppose A is an arbitrary measurable set, and define:

A1={x∈A:f1(x)>f2(x)},A2={x∈A:f2(x)≥f1(x)}.

Then one has

∫Amax⁡{f1,f2}dμ=∫A1f1dμ+∫A2f2dμ≤ν(A1)+ν(A2)=ν(A),

and therefore, max{ f 1, f 2} ∈ F.

Now, let { fn } be a sequence of functions in F such that

limn->∞∫Xfndμ=supf∈F∫Xfdμ.

By replacing  fn with the maximum of the first n functions, one can assume that the sequence { fn } is increasing. Let g be an extended-valued function defined as

g(x):=limn->∞fn(x).

By Lebesgue's monotone convergence theorem, one has

limn->∞∫Afndμ=∫Alimn->∞fn(x)dμ(x)=∫Agdμ≤ν(A)

for each A ∈ Σ, and hence, g ∈ F. Also, by the construction of g,

∫Xgdμ=supf∈F∫Xfdμ.

Proving equality Now, since g ∈ F,

ν0(A):=ν(A)−∫Agdμ

defines a nonnegative measure on Σ. To prove equality, we show that ν0 = 0.

Suppose ν0 ≠ 0; then, since μ is finite, there is an ε > 0 such that ν0(X) > ε μ(X). To derive a contradiction from ν0 ≠ 0, we look for a positive set P ∈ Σ for the signed measure ν0 − ε μ (i.e. a measurable set P, all of whose measurable subsets have non-negative ν0 − εμ measure), where also P has positive μ-measure. Conceptually, we're looking for a set P, where ν0 ≥ ε μ in every part of P. A convenient approach is to use the Hahn decomposition (P, N) for the signed measure ν0 − ε μ.

Note then that for every A ∈ Σ one has ν0(A ∩ P) ≥ ε μ(A ∩ P), and hence,

ν(A)=∫Agdμ+ν0(A)≥∫Agdμ+ν0(A∩P)≥∫Agdμ+εμ(A∩P)=∫A(g+ε1P)dμ,

where 1P is the indicator function of P. Also, note that μ(P) > 0 as desired; for if μ(P) = 0, then (since ν is absolutely continuous in relation to μ) ν0(P) ≤ ν(P) = 0, so ν0(P) = 0 and

ν0(X)−εμ(X)=(ν0−εμ)(N)≤0,

contradicting the fact that ν0(X) > εμ(X).

Then, since also

∫X(g+ε1P)dμ≤ν(X)<+∞,

g \+ ε 1P ∈ F and satisfies

∫X(g+ε1P)dμ>∫Xgdμ=supf∈F∫Xfdμ.

This is impossible because it violates the definition of a supremum; therefore, the initial assumption that ν0 ≠ 0 must be false. Hence, ν0 = 0, as desired.

Restricting to finite values Now, since g is μ-integrable, the set {x ∈ X : g(x) = ∞} is μ-null. Therefore, if a  f is defined as

f(x)={g(x)if g(x)<∞0otherwise,

then f has the desired properties.

Uniqueness As for the uniqueness, let  f, g : X → [0, ∞) be measurable functions satisfying

ν(A)=∫Afdμ=∫Agdμ

for every measurable set A. Then, g − f is μ-integrable, and

∫A(g−f)dμ=0. (Recall that we can split the integral into two as long as they are measurable and non-negative)

In particular, for A = {x ∈ X : f(x) > g(x)}, or {x ∈ X : f(x) < g(x)}. It follows that

∫X(g−f)+dμ=0=∫X(g−f)−dμ,

and so, that (g − f )+ = 0 μ-almost everywhere; the same is true for (g − f )−, and thus, f = g μ-almost everywhere, as desired.

### For σ-finite positive measures

If μ and ν are σ-finite, then X can be written as the union of a sequence {Bn}n of disjoint sets in Σ, each of which has finite measure under both μ and ν. For each n, by the finite case, there is a Σ-measurable function  fn : Bn → [0, ∞) such that

νn(A)=∫Afndμ

for each Σ-measurable subset A of Bn. The sum (∑nfn1Bn):=f of those functions is then the required function such that ν(A)=∫Afdμ.

As for the uniqueness, since each of the fn is μ-almost everywhere unique, so is f.

### For signed and complex measures

If ν is a σ-finite signed measure, then it can be Hahn–Jordan decomposed as ν = ν+ − ν− where one of the measures is finite. Applying the previous result to those two measures, one obtains two functions, g, h : X → [0, ∞), satisfying the Radon–Nikodym theorem for ν+ and ν− respectively, at least one of which is μ-integrable (i.e., its integral with respect to μ is finite). It is clear then that f = g − h satisfies the required properties, including uniqueness, since both g and h are unique up to μ-almost everywhere equality.

If ν is a complex measure, it can be decomposed as ν = ν1 \+ iν2, where both ν1 and ν2 are finite-valued signed measures. Applying the above argument, one obtains two functions, g, h : X → [0, ∞), satisfying the required properties for ν1 and ν2, respectively. Clearly, f = g \+ ih is the required function.

## The Lebesgue decomposition theorem

Lebesgue's decomposition theorem shows that the assumptions of the Radon–Nikodym theorem can be found even in a situation which is seemingly more general. Consider a σ-finite positive measure μ on the measure space (X,Σ) and a σ-finite signed measure ν on Σ, without assuming any absolute continuity. Then there exist unique signed measures νa and νs on Σ such that ν=νa+νs, νa≪μ, and νs⊥μ. The Radon–Nikodym theorem can then be applied to the pair νa,μ.

## See also

* Girsanov theorem
* Radon–Nikodym set

## Notes

1. ↑ Billingsley, Patrick (1995). Probability and Measure (Third ed.). New York: John Wiley & Sons. pp. 419–427. ISBN 0-471-00710-2.
2. ↑ 2.0 2.1 Brown, Arlen; Pearcy, Carl (1977). Introduction to Operator Theory I: Elements of Functional Analysis. ISBN 978-1461299288.
3. ↑ Fonseca, Irene; Leoni, Giovanni. Modern Methods in the Calculus of Variations: Lp Spaces. Springer. p. 68. ISBN 978-0-387-35784-3.

## References

* Lang, Serge (1969). Analysis II: Real analysis. Addison-Wesley. Contains a proof for vector measures assuming values in a Banach space.
* Royden, H. L.; Fitzpatrick, P. M. (2010). Real Analysis (4th ed.). Pearson. Contains a lucid proof in case the measure ν is not σ-finite.
* Shilov, G. E.; Gurevich, B. L. (1978). Integral, Measure, and Derivative: A Unified Approach. Richard A. Silverman, trans.. Dover Publications. ISBN 0-486-63519-8.
* Stein, Elias M.; Shakarchi, Rami (2005). Real analysis: measure theory, integration, and Hilbert spaces. Princeton lectures in analysis. Princeton, N.J: Princeton University Press. ISBN 978-0-691-11386-9. Contains a proof of the generalisation.
* Teschl, Gerald. "Topics in Real and Functional Analysis". https://www.mat.univie.ac.at/~gerald/ftp/book-fa/index.html.

This article incorporates material from Radon–Nikodym theorem on PlanetMath, which is licensed under the Creative Commons Attribution/Share-Alike License.

Template:Measure theory

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Radon–Nikodym theorem. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Radon–Nikodym_theorem&oldid=4153662"