Split normal distribution

In probability theory and statistics, the split normal distribution also known as the two-piece normal distribution results from joining at the mode the corresponding halves of two normal distributions with the same mode but different variances. It is claimed by Johnson et al.[1] that this distribution was introduced by Gibbons and Mylroie[2] and by John.[3] But these are two of several independent rediscoveries of the Zweiseitige Gauss'sche Gesetz introduced in the posthumously published Kollektivmasslehre (1897)[4] of Gustav Theodor Fechner (1801-1887), see Wallis (2014).[5] Another rediscovery has appeared more recently in a finance journal.[6]

Split-normalNotation|  S N ( μ , σ 1 , σ 2 ) {\displaystyle {\mathcal {SN}}(\mu ,\,\sigma _{1},\sigma _{2})}

|

Parameters|  μ ∈ ℜ {\displaystyle \mu \in \Re } — mode (location, real)
σ 1 > 0 {\displaystyle \sigma _{1}>0} — left-hand-side standard deviation (scale, real)
σ 2 > 0 {\displaystyle \sigma _{2}>0} — right-hand-side standard deviation (scale, real)
Support|  x ∈ ℜ {\displaystyle x\in \Re }
PDF|

A exp ⁡ ( − ( x − μ ) 2 2 σ 1 2 ) if x < μ {\displaystyle A\exp \left(-{\frac {(x-\mu )^{2}}{2\sigma _{1}^{2}}}\right)\quad {\text{if }}x<\mu }
A exp ⁡ ( − ( x − μ ) 2 2 σ 2 2 ) otherwise, {\displaystyle A\exp \left(-{\frac {(x-\mu )^{2}}{2\sigma _{2}^{2}}}\right)\quad {\text{otherwise,}}}

where A = 2 / π ( σ 1 + σ 2 ) − 1 {\displaystyle {\text{where}}\quad A={\sqrt {2/\pi }}(\sigma _{1}+\sigma _{2})^{-1}}
Mean|  μ + 2 / π ( σ 2 − σ 1 ) {\displaystyle \mu +{\sqrt {2/\pi }}(\sigma _{2}-\sigma _{1})}
Mode|  μ {\displaystyle \mu }
Variance|  ( 1 − 2 / π ) ( σ 2 − σ 1 ) 2 + σ 1 σ 2 {\displaystyle (1-2/\pi )(\sigma _{2}-\sigma _{1})^{2}+\sigma _{1}\sigma _{2}}
Skewness|  γ 3 = 2 π ( σ 2 − σ 1 ) [ ( 4 π − 1 ) ( σ 2 − σ 1 ) 2 + σ 1 σ 2 ] {\displaystyle \gamma _{3}={\sqrt {\frac {2}{\pi }}}(\sigma _{2}-\sigma _{1})\left[\left({\frac {4}{\pi }}-1\right)(\sigma _{2}-\sigma _{1})^{2}+\sigma _{1}\sigma _{2}\right]}

## Definition

[edit]

The split normal distribution arises from merging two opposite halves of two probability density functions (PDFs) of normal distributions in their common mode.

The PDF of the split normal distribution is given by[1]

f ( x ; μ , σ 1 , σ 2 ) = { A exp ⁡ ( − ( x − μ ) 2 2 σ 1 2 ) if x < μ A exp ⁡ ( − ( x − μ ) 2 2 σ 2 2 ) otherwise {\displaystyle f(x;\mu ,\sigma _{1},\sigma _{2})={\begin{cases}A\exp \left(-{\dfrac {(x-\mu )^{2}}{2\sigma _{1}^{2}}}\right)&{\text{if }}x<\mu \\\\[1ex]A\exp \left(-{\dfrac {(x-\mu )^{2}}{2\sigma _{2}^{2}}}\right)&{\text{otherwise}}\end{cases}}}

where

A = 2 / π ( σ 1 + σ 2 ) − 1 . {\displaystyle \quad A={\sqrt {2/\pi }}(\sigma _{1}+\sigma _{2})^{-1}.}

### Discussion

[edit]

The split normal distribution results from merging two halves of normal distributions. In a general case the 'parent' normal distributions can have different variances which implies that the joined PDF would not be continuous. To ensure that the resulting PDF integrates to 1, the normalizing constant A is used.

In a special case when  σ 1 2 = σ 2 2 = σ ∗ 2 {\displaystyle \sigma _{1}^{2}=\sigma _{2}^{2}=\sigma _{*}^{2}} the split normal distribution reduces to normal distribution with variance  σ ∗ 2 {\displaystyle \sigma _{*}^{2}} .

When σ2≠σ1 the constant A is different from the constant of normal distribution. However, when  σ 1 2 = σ 2 2 = σ ∗ 2 {\displaystyle \sigma _{1}^{2}=\sigma _{2}^{2}=\sigma _{*}^{2}} the constants are equal.

The sign of its third central moment is determined by the difference (σ2-σ1). If this difference is positive, the distribution is skewed to the right and if negative, then it is skewed to the left.

Other properties of the split normal density were discussed by Johnson et al.[1] and Julio.[7]

## Alternative formulations

[edit]

The formulation discussed above originates from John.[3] The literature offers two mathematically equivalent alternative parameterizations . Britton, Fisher and Whitley[8] offer a parameterization if terms of mode, dispersion and normed skewness, denoted with  S N ( μ , σ 2 , γ ) {\displaystyle {\mathcal {SN}}(\mu ,\,\sigma ^{2},\gamma )} . The parameter μ is the mode and has equivalent to the mode in John's formulation. The parameter σ 2>0 informs about the dispersion (scale) and should not be confused with variance. The third parameter, γ ∈ (-1,1), is the normalized skew.

The second alternative parameterization is used in the Bank of England's communication and is written in terms of mode, dispersion and unnormed skewness and is denoted with  S N ( μ , σ 2 , ξ ) {\displaystyle {\mathcal {SN}}(\mu ,\,\sigma ^{2},\xi )} . In this formulation the parameter μ is the mode and is identical as in John's [3] and Britton, Fisher and Whitley's [8] formulation. The parameter σ 2 informs about the dispersion (scale) and is the same as in the Britton, Fisher and Whitley's formulation. The parameter ξ equals the difference between the distribution's mean and mode and can be viewed as unnormed measure of skewness.

The three parameterizations are mathematically equivalent, meaning that there is a strict relationship between the parameters and that it is possible to go from one parameterization to another. The following relationships hold:[9]

σ 2 = σ 1 2 ( 1 + γ ) = σ 2 2 ( 1 − γ ) γ = σ 2 2 − σ 1 2 σ 2 2 + σ 1 2 ξ = 2 / π ( σ 2 − σ 1 ) γ = sgn ⁡ ( ξ ) 1 − ( 1 + 2 β − 1 β ) 2 , where β = π ξ 2 2 σ 2 . {\displaystyle {\begin{aligned}\sigma ^{2}&=\sigma _{1}^{2}(1+\gamma )=\sigma _{2}^{2}(1-\gamma )\\\\\gamma &={\frac {\sigma _{2}^{2}-\sigma _{1}^{2}}{\sigma _{2}^{2}+\sigma _{1}^{2}}}\\\\\xi &={\sqrt {2/\pi }}(\sigma _{2}-\sigma _{1})\\\\\gamma &=\operatorname {sgn} (\xi ){\sqrt {1-\left({\frac {{\sqrt {1+2\beta }}-1}{\beta }}\right)^{2}}},\quad {\text{where}}\quad \beta ={\frac {\pi \xi ^{2}}{2\sigma ^{2}}}.\end{aligned}}}

## Multivariate Extensions

[edit]

The multivariate generalization of the split normal distribution was proposed by Villani and Larsson.[10] They assume that each of the principal components has univariate split normal distribution with a different set of parameters μ, σ2 and σ1.

## Estimation of parameters

[edit]

John[3] proposes to estimate the parameters using maximum likelihood method. He shows that the likelihood function can be expressed in an intensive form, in which the scale parameters σ1 and σ2 are a function of the location parameter μ. The likelihood in its intensive form is:

L ( μ ) = − [ ∑ x i : x i < μ ( x i − μ ) 2 ] 1 / 3 − [ ∑ x i : x i > μ ( x i − μ ) 2 ] 1 / 3 {\displaystyle L(\mu )=-\left[\sum _{x_{i}:x_{i}<\mu }(x_{i}-\mu )^{2}\right]^{1/3}-\left[\sum _{x_{i}:x_{i}>\mu }(x_{i}-\mu )^{2}\right]^{1/3}}

and has to be maximized numerically with respect to a single parameter μ only.

Given the maximum likelihood estimator  μ ^ {\displaystyle {\hat {\mu }}} the other parameters take values:

σ ^ 1 2 = − L ( μ ) N [ ∑ x i : x i < μ ( x i − μ ) 2 ] 2 / 3 , {\displaystyle {\hat {\sigma }}_{1}^{2}={\frac {-L(\mu )}{N}}\left[\sum _{x_{i}:x_{i}<\mu }(x_{i}-\mu )^{2}\right]^{2/3},}
σ ^ 2 2 = − L ( μ ) N [ ∑ x i : x i > μ ( x i − μ ) 2 ] 2 / 3 , {\displaystyle {\hat {\sigma }}_{2}^{2}={\frac {-L(\mu )}{N}}\left[\sum _{x_{i}:x_{i}>\mu }(x_{i}-\mu )^{2}\right]^{2/3},}

where N is the number of observations.

Villani and Larsson[10] propose to use either maximum likelihood method or bayesian estimation and provide some analytical results for either univariate and multivariate case.

## Applications

[edit]

The split normal distribution has been used mainly in econometrics and time series. A remarkable area of application is the construction of the fan chart, a representation of the inflation forecast distribution reported by inflation targeting central banks around the globe.[7][11]

## References

[edit]

1. ^ a b c Johnson, N.L., Kotz, S. and Balakrishnan, N. (1994). Continuous Univariate Distributions, Volume 1. John Wiley & Sons. p. 173\. ISBN 978-0-471-58495-7.`{{cite book}}`: CS1 maint: multiple names: authors list (link)
2. ^ Gibbons, J.F.; Mylroie, S. (1973). "Estimation of impurity profiles in ion-implanted amorphous targets using joined half-Gaussian distributions". Applied Physics Letters. 22 (11): 568–569\. Bibcode:1973ApPhL..22..568G. doi:10.1063/1.1654511.
3. ^ a b c d John, S. (1982). "The three-parameter two-piece normal family of distributions and its fitting". Communications in Statistics - Theory and Methods. 11 (8): 879–885\. doi:10.1080/03610928208828279.
4. ^ Fechner, G.T. (ed. Lipps, G.F.) (1897). Kollectivmasslehre. Engelmann, Leipzig.
5. ^ Wallis, K.F. (2014). The two-piece normal, binormal, or double Gaussian distribution: its origin and rediscoveries. Statistical Science, vol. 29, no. 1, pp.106-112. doi:10.1214/13-STS417.
6. ^ de Roon, F. and Karehnke, P. (2016). A simple skewed distribution with asset pricing applications. Review of Finance, 2016, 1-29.
7. ^ a b Juan Manuel Julio (2007). The Fan Chart: The Technical Details Of The New Implementation. Banco de la República. Retrieved 2010-09-11, direct link `{{cite conference}}`: External link in ``|postscript=`` (help)CS1 maint: postscript (link)
8. ^ a b Britton, E.; P. Fisher; Whitley, J. (1998). "The inflation report projections: understanding the fan chart". Quarterly Bulletin. February 1998: 30–37.
9. ^ Banerjee, N.; A. Das (2011). Fan Chart: Methodology and its Application to Inflation Forecasting in India. Reserve Bank of India Working Paper Series.
10. ^ a b Villani, Mattias; Rolf Larsson (2006). "The Multivariate Split Normal Distribution and Asymmetric Principal Components Analysis". Communications in Statistics - Theory and Methods. 35 (6): 1123–1140\. CiteSeerX 10.1.1.533.4095. doi:10.1080/03610920600672252. ISSN 0361-0926. S2CID 124959166.
11. ^ Bank of England, Inflation Report Archived 2010-08-13 at the Wayback Machine

* v
* t
* e

Probability distributions (list)

Discrete
univariate|

| with finite
support|

* Benford
* Bernoulli
* Beta-binomial
* Binomial
* Categorical
* Hypergeometric
* Negative
* Poisson binomial
* Rademacher
* Soliton
* Discrete uniform
* Zipf
* Zipf–Mandelbrot

|

with infinite
support|

* Beta negative binomial
* Borel
* Conway–Maxwell–Poisson
* Discrete phase-type
* Delaporte
* Extended negative binomial
* Flory–Schulz
* Gauss–Kuzmin
* Geometric
* Logarithmic
* Mixed Poisson
* Negative binomial
* Panjer
* Parabolic fractal
* Poisson
* Skellam
* Yule–Simon
* Zeta

Continuous
univariate|

| supported on a
bounded interval|

* Arcsine
* ARGUS
* Balding–Nichols
* Bates
* Beta
* Generalized
* Beta rectangular
* Continuous Bernoulli
* Irwin–Hall
* Kumaraswamy
* Logit-normal
* Noncentral beta
* PERT
* Raised cosine
* Reciprocal
* Triangular
* U-quadratic
* Uniform
* Wigner semicircle

|

supported on a
semi-infinite
interval|

* Benini
* Benktander 1st kind
* Benktander 2nd kind
* Beta prime
* Burr
* Chi
* Chi-squared
* Noncentral
* Inverse
* Scaled
* Dagum
* Davis
* Erlang
* Hyper
* Exponential
* Hyperexponential
* Hypoexponential
* Logarithmic
* F
* Noncentral
* Folded normal
* Fréchet
* Gamma
* Generalized
* Inverse
* gamma/Gompertz
* Gompertz
* Shifted
* Half-logistic
* Half-normal
* Hotelling's T-squared
* Hartman–Watson
* Inverse Gaussian
* Generalized
* Kolmogorov
* Lévy
* Log-Cauchy
* Log-Laplace
* Log-logistic
* Log-normal
* Log-t
* Lomax
* Matrix-exponential
* Maxwell–Boltzmann
* Maxwell–Jüttner
* Mittag-Leffler
* Nakagami
* Pareto
* Phase-type
* Poly-Weibull
* Rayleigh
* Relativistic Breit–Wigner
* Rice
* Truncated normal
* type-2 Gumbel
* Weibull
* Discrete
* Wilks's lambda

supported
on the whole
real line|

* Cauchy
* Exponential power
* Fisher's z
* Kaniadakis κ-Gaussian
* Gaussian q
* Generalized normal
* Generalized hyperbolic
* Geometric stable
* Gumbel
* Holtsmark
* Hyperbolic secant
* Johnson's SU
* Landau
* Laplace
* Asymmetric
* Logistic
* Noncentral t
* Normal (Gaussian)
* Normal-inverse Gaussian
* Skew normal
* Slash
* Stable
* Student's t
* Tracy–Widom
* Variance-gamma
* Voigt

with support
whose type varies|

* Generalized chi-squared
* Generalized extreme value
* Generalized Pareto
* Marchenko–Pastur
* Kaniadakis κ-exponential
* Kaniadakis κ-Gamma
* Kaniadakis κ-Weibull
* Kaniadakis κ-Logistic
* Kaniadakis κ-Erlang
* q-exponential
* q-Gaussian
* q-Weibull
* Shifted log-logistic
* Tukey lambda

Mixed
univariate|

| continuous-
discrete|

* Rectified Gaussian

|

Multivariate
(joint)|

* Discrete:
* Ewens
* Multinomial
* Dirichlet
* Negative
* Continuous:
* Dirichlet
* Generalized
* Multivariate Laplace
* Multivariate normal
* Multivariate stable
* Multivariate t
* Normal-gamma
* Inverse
* Matrix-valued:
* LKJ
* Matrix beta
* Matrix normal
* Matrix t
* Matrix gamma
* Inverse
* Wishart
* Normal
* Inverse
* Normal-inverse
* Complex
* Uniform distribution on a Stiefel manifold

Directional|

Univariate (circular) directional
Circular uniform
Univariate von Mises
Wrapped normal
Wrapped Cauchy
Wrapped exponential
Wrapped asymmetric Laplace
Wrapped Lévy
Bivariate (spherical)
Kent
Bivariate (toroidal)
Bivariate von Mises
Multivariate
von Mises–Fisher
Bingham

Degenerate
and singular|

Degenerate
Dirac delta function
Singular
Cantor

Families|

* Circular
* Compound Poisson
* Elliptical
* Exponential
* Natural exponential
* Location–scale
* Maximum entropy
* Mixture
* Pearson
* Tweedie
* Wrapped

* Category
* Commons

*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template