Skew normal distribution

Probability distribution

Skew Normal

Probability density function

Cumulative distribution function

Parameters|  ξ {\displaystyle \xi \,} location (real)
ω {\displaystyle \omega \,} scale (positive, real)
α {\displaystyle \alpha \,} shape (real)
Support|  x ∈ ( − ∞ ; + ∞ ) {\displaystyle x\in (-\infty ;+\infty )\\!}
PDF|  2 ω 2 π e − ( x − ξ ) 2 2 ω 2 ∫ − ∞ α ( x − ξ ω ) 1 2 π e − t 2 2 d t {\displaystyle {\frac {2}{\omega {\sqrt {2\pi }}}}e^{-{\frac {(x-\xi )^{2}}{2\omega ^{2}}}}\int _{-\infty }^{\alpha \left({\frac {x-\xi }{\omega }}\right)}{\frac {1}{\sqrt {2\pi }}}e^{-{\frac {t^{2}}{2}}}\ \mathrm {d} t}
CDF|  Φ ( x − ξ ω ) − 2 T ( x − ξ ω , α ) {\displaystyle \Phi \left({\frac {x-\xi }{\omega }}\right)-2T\left({\frac {x-\xi }{\omega }},\alpha \right)}
T ( h , a ) {\displaystyle T(h,a)} is Owen's T function
Mean|  ξ + ω δ 2 π {\displaystyle \xi +\omega \delta {\sqrt {\frac {2}{\pi }}}} where  δ = α 1 + α 2 {\displaystyle \delta ={\frac {\alpha }{\sqrt {1+\alpha ^{2}}}}}
Mode|  ξ + ω m o ( α ) {\displaystyle \xi +\omega m_{o}(\alpha )}
Variance|  ω 2 ( 1 − 2 δ 2 π ) {\displaystyle \omega ^{2}\left(1-{\frac {2\delta ^{2}}{\pi }}\right)}
Skewness|  γ 1 = 4 − π 2 ( δ 2 / π ) 3 ( 1 − 2 δ 2 / π ) 3 / 2 {\displaystyle \gamma _{1}={\frac {4-\pi }{2}}{\frac {\left(\delta {\sqrt {2/\pi }}\right)^{3}}{\left(1-2\delta ^{2}/\pi \right)^{3/2}}}}
Excess kurtosis|  2 ( π − 3 ) ( δ 2 / π ) 4 ( 1 − 2 δ 2 / π ) 2 {\displaystyle 2(\pi -3){\frac {\left(\delta {\sqrt {2/\pi }}\right)^{4}}{\left(1-2\delta ^{2}/\pi \right)^{2}}}}
MGF|  M X ( t ) = 2 exp ⁡ ( ξ t + ω 2 t 2 2 ) Φ ( ω δ t ) {\displaystyle M_{X}\left(t\right)=2\exp \left(\xi t+{\frac {\omega ^{2}t^{2}}{2}}\right)\Phi \left(\omega \delta t\right)}
CF|  e i t ξ − t 2 ω 2 / 2 ( 1 + i Erfi ( δ ω t 2 ) ) {\displaystyle e^{it\xi -t^{2}\omega ^{2}/2}\left(1+i\,{\textrm {Erfi}}\left({\frac {\delta \omega t}{\sqrt {2}}}\right)\right)}

In probability theory and statistics, the skew normal distribution is a continuous probability distribution that generalises the normal distribution to allow for non-zero skewness.

## Definition

[edit]

Let  ϕ ( x ) {\displaystyle \phi (x)} denote the standard normal probability density function

ϕ ( x ) = 1 2 π e − x 2 2 {\displaystyle \phi (x)={\frac {1}{\sqrt {2\pi }}}e^{-{\frac {x^{2}}{2}}}}

with the cumulative distribution function given by

Φ ( x ) = ∫ − ∞ x ϕ ( t ) d t = 1 2 [ 1 + erf ⁡ ( x 2 ) ] , {\displaystyle \Phi (x)=\int _{-\infty }^{x}\phi (t)\ \mathrm {d} t={\frac {1}{2}}\left[1+\operatorname {erf} \left({\frac {x}{\sqrt {2}}}\right)\right],}

where "erf" is the error function. Then the probability density function (pdf) of the skew-normal distribution with parameter  α {\displaystyle \alpha } is given by

f ( x ) = 2 ϕ ( x ) Φ ( α x ) . {\displaystyle f(x)=2\phi (x)\Phi (\alpha x).\,}

This distribution was first introduced by O'Hagan and Leonard (1976).[1] Alternative forms to this distribution, with the corresponding quantile function, have been given by Ashour and Abdel-Hamid[2] and by Mudholkar and Hutson.[3]

A stochastic process that underpins the distribution was described by Andel, Netuka and Zvara (1984).[4] Both the distribution and its stochastic process underpinnings were consequences of the symmetry argument developed in Chan and Tong (1986),[5] which applies to multivariate cases beyond normality, e.g. skew multivariate t distribution and others. The distribution is a particular case of a general class of distributions with probability density functions of the form  f ( x ) = 2 ϕ ( x ) Φ ( x ) {\displaystyle f(x)=2\phi (x)\Phi (x)} where  ϕ ( ⋅ ) {\displaystyle \phi (\cdot )} is any PDF symmetric about zero and  Φ ( ⋅ ) {\displaystyle \Phi (\cdot )} is any CDF whose PDF is symmetric about zero.[6]

To add location and scale parameters to this, one makes the usual transform  x -> x − ξ ω {\displaystyle x\rightarrow {\frac {x-\xi }{\omega }}} . One can verify that the normal distribution is recovered when  α = 0 {\displaystyle \alpha =0} , and that the absolute value of the skewness increases as the absolute value of  α {\displaystyle \alpha } increases. The distribution is right skewed if  α > 0 {\displaystyle \alpha >0} and is left skewed if  α < 0 {\displaystyle \alpha <0} . The probability density function with location  ξ {\displaystyle \xi } , scale  ω {\displaystyle \omega } , and parameter  α {\displaystyle \alpha } becomes

f ( x ) = 2 ω ϕ ( x − ξ ω ) Φ ( α ( x − ξ ω ) ) . {\displaystyle f(x)={\frac {2}{\omega }}\phi \left({\frac {x-\xi }{\omega }}\right)\Phi \left(\alpha \left({\frac {x-\xi }{\omega }}\right)\right).\,}

The skewness ( γ 1 {\displaystyle \gamma _{1}} ) of the distribution is limited to slightly less than the interval  ( − 1 , 1 ) {\displaystyle (-1,1)} (see Estimation).

As has been shown,[7] the mode (maximum)  m o {\displaystyle m_{o}} of the distribution is unique. For general  α {\displaystyle \alpha } there is no analytic expression for  m o {\displaystyle m_{o}} , but a quite accurate (numerical) approximation is:

δ = α 1 + α 2 m o ( α ) ≈ 2 π δ − ( 1 − π 4 ) ( 2 π δ ) 3 1 − 2 π δ 2 − s g n ( α ) 2 e ( − 2 π | α | ) {\displaystyle {\begin{aligned}\delta &={\frac {\alpha }{\sqrt {1+\alpha ^{2}}}}\\\m_{o}(\alpha )&\approx {\sqrt {\frac {2}{\pi }}}\delta -\left(1-{\frac {\pi }{4}}\right){\frac {\left({\sqrt {\frac {2}{\pi }}}\delta \right)^{3}}{1-{\frac {2}{\pi }}\delta ^{2}}}-{\frac {\mathrm {sgn} (\alpha )}{2}}e^{\left(-{\frac {2\pi }{|\alpha |}}\right)}\\\\\end{aligned}}}

## Estimation

[edit]

Maximum likelihood estimates for  ξ {\displaystyle \xi } ,  ω {\displaystyle \omega } , and  α {\displaystyle \alpha } can be computed numerically, but no closed-form expression for the estimates is available unless  α = 0 {\displaystyle \alpha =0} . In contrast, the method of moments has a closed-form expression since the skewness equation can be inverted with

| δ | = π 2 | γ 1 | 2 3 | γ 1 | 2 3 + ( ( 4 − π ) / 2 ) 2 3 {\displaystyle |\delta |={\sqrt {{\frac {\pi }{2}}{\frac {|\gamma _{1}|^{\frac {2}{3}}}{|\gamma _{1}|^{\frac {2}{3}}+((4-\pi )/2)^{\frac {2}{3}}}}}}}

where  δ = α 1 + α 2 {\displaystyle \delta ={\frac {\alpha }{\sqrt {1+\alpha ^{2}}}}} and the sign of  δ {\displaystyle \delta } is the same as the sign of  γ 1 {\displaystyle \gamma _{1}} . Consequently,  α = δ 1 − δ 2 {\displaystyle \alpha ={\frac {\delta }{\sqrt {1-\delta ^{2}}}}} ,  ω = σ 1 − 2 δ 2 / π {\displaystyle \omega ={\frac {\sigma }{\sqrt {1-2\delta ^{2}/\pi }}}} , and  ξ = μ − ω δ 2 π {\displaystyle \xi =\mu -\omega \delta {\sqrt {\frac {2}{\pi }}}} where  μ {\displaystyle \mu } and  σ {\displaystyle \sigma } are the mean and standard deviation. As long as the sample skewness  γ ^ 1 {\displaystyle {\hat {\gamma }}_{1}} is not too large, these formulas provide method of moments estimates  α ^ {\displaystyle {\hat {\alpha }}} ,  ω ^ {\displaystyle {\hat {\omega }}} , and  ξ ^ {\displaystyle {\hat {\xi }}} based on a sample's  μ ^ {\displaystyle {\hat {\mu }}} ,  σ ^ {\displaystyle {\hat {\sigma }}} , and  γ ^ 1 {\displaystyle {\hat {\gamma }}_{1}} .

The maximum (theoretical) skewness is obtained by setting  δ = 1 {\displaystyle {\delta =1}} in the skewness equation, giving  γ 1 ≈ 0.9952717 {\displaystyle \gamma _{1}\approx 0.9952717} . However it is possible that the sample skewness is larger, and then  α {\displaystyle \alpha } cannot be determined from these equations. When using the method of moments in an automatic fashion, for example to give starting values for maximum likelihood iteration, one should therefore let (for example)  | γ ^ 1 | = min ( 0.99 , | ( 1 / n ) ∑ ( ( x i − μ ^ ) / σ ^ ) 3 | ) {\displaystyle |{\hat {\gamma }}_{1}|=\min(0.99,|(1/n)\sum {((x_{i}-{\hat {\mu }})/{\hat {\sigma }})^{3}}|)} .

Concern has been expressed about the impact of skew normal methods on the reliability of inferences based upon them.[8]

## Related distributions

[edit]

The exponentially modified normal distribution is another 3-parameter distribution that is a generalization of the normal distribution to skewed cases. The skew normal still has a normal-like tail in the direction of the skew, with a shorter tail in the other direction; that is, its density is asymptotically proportional to  e − k x 2 {\displaystyle e^{-kx^{2}}} for some positive  k {\displaystyle k} . Thus, in terms of the seven states of randomness, it shows "proper mild randomness". In contrast, the exponentially modified normal has an exponential tail in the direction of the skew; its density is asymptotically proportional to  e − k | x | {\displaystyle e^{-k|x|}} . In the same terms, it shows "borderline mild randomness".

Thus, the skew normal is useful for modeling skewed distributions which nevertheless have no more outliers than the normal, while the exponentially modified normal is useful for cases with an increased incidence of outliers in (just) one direction.

## See also

[edit]

* Generalized normal distribution
* Log-normal distribution

## References

[edit]

1. ^ O'Hagan, A.; Leonard, Tom (1976). "Bayes estimation subject to uncertainty about parameter constraints". Biometrika. 63 (1): 201–203\. doi:10.1093/biomet/63.1.201. ISSN 0006-3444.
2. ^ Ashour, Samir K.; Abdel-hameed, Mahmood A. (October 2010). "Approximate skew normal distribution". Journal of Advanced Research. 1 (4): 341–350\. doi:10.1016/j.jare.2010.06.004. ISSN 2090-1232.
3. ^ Mudholkar, Govind S.; Hutson, Alan D. (February 2000). "The epsilon–skew–normal distribution for analyzing near-normal data". Journal of Statistical Planning and Inference. 83 (2): 291–309\. doi:10.1016/s0378-3758(99)00096-8. ISSN 0378-3758.
4. ^ Andel, J., Netuka, I. and Zvara, K. (1984) On threshold autoregressive processes. Kybernetika, 20, 89-106
5. ^ Chan, K. S.; Tong, H. (March 1986). "A note on certain integral equations associated with non-linear time series analysis". Probability Theory and Related Fields. 73 (1): 153–158\. doi:10.1007/bf01845999. ISSN 0178-8051. S2CID 121106515.
6. ^ Azzalini, A. (1985). "A class of distributions which includes the normal ones". Scandinavian Journal of Statistics. 12: 171–178.
7. ^ Azzalini, Adelchi; Capitanio, Antonella (2014). The skew-normal and related families. pp. 32–33\. ISBN 978-1-107-02927-9.
8. ^ Pewsey, Arthur. "Problems of inference for Azzalini's skewnormal distribution." Journal of Applied Statistics 27.7 (2000): 859-870

## External links

[edit]

* The multi-variate skew-normal distribution with an application to body mass, height and Body Mass Index
* A very brief introduction to the skew-normal distribution
* The Skew-Normal Probability Distribution (and related distributions, such as the skew-t)
* OWENS: Owen's T Function Archived 2010-06-14 at the Wayback Machine
* Closed-skew Distributions - Simulation, Inversion and Parameter Estimation

* v
* t
* e

Probability distributions (list)

Discrete
univariate|

| with finite
support|

* Benford
* Bernoulli
* Beta-binomial
* Binomial
* Categorical
* Hypergeometric
* Negative
* Poisson binomial
* Rademacher
* Soliton
* Discrete uniform
* Zipf
* Zipf–Mandelbrot

|

with infinite
support|

* Beta negative binomial
* Borel
* Conway–Maxwell–Poisson
* Discrete phase-type
* Delaporte
* Extended negative binomial
* Flory–Schulz
* Gauss–Kuzmin
* Geometric
* Logarithmic
* Mixed Poisson
* Negative binomial
* Panjer
* Parabolic fractal
* Poisson
* Skellam
* Yule–Simon
* Zeta

Continuous
univariate|

| supported on a
bounded interval|

* Arcsine
* ARGUS
* Balding–Nichols
* Bates
* Beta
* Generalized
* Beta rectangular
* Continuous Bernoulli
* Irwin–Hall
* Kumaraswamy
* Logit-normal
* Noncentral beta
* PERT
* Raised cosine
* Reciprocal
* Triangular
* U-quadratic
* Uniform
* Wigner semicircle

|

supported on a
semi-infinite
interval|

* Benini
* Benktander 1st kind
* Benktander 2nd kind
* Beta prime
* Burr
* Chi
* Chi-squared
* Noncentral
* Inverse
* Scaled
* Dagum
* Davis
* Erlang
* Hyper
* Exponential
* Hyperexponential
* Hypoexponential
* Logarithmic
* F
* Noncentral
* Folded normal
* Fréchet
* Gamma
* Generalized
* Inverse
* gamma/Gompertz
* Gompertz
* Shifted
* Half-logistic
* Half-normal
* Hotelling's T-squared
* Hartman–Watson
* Inverse Gaussian
* Generalized
* Kolmogorov
* Lévy
* Log-Cauchy
* Log-Laplace
* Log-logistic
* Log-normal
* Log-t
* Lomax
* Matrix-exponential
* Maxwell–Boltzmann
* Maxwell–Jüttner
* Mittag-Leffler
* Nakagami
* Pareto
* Phase-type
* Poly-Weibull
* Rayleigh
* Relativistic Breit–Wigner
* Rice
* Truncated normal
* type-2 Gumbel
* Weibull
* Discrete
* Wilks's lambda

supported
on the whole
real line|

* Cauchy
* Exponential power
* Fisher's z
* Kaniadakis κ-Gaussian
* Gaussian q
* Generalized normal
* Generalized hyperbolic
* Geometric stable
* Gumbel
* Holtsmark
* Hyperbolic secant
* Johnson's SU
* Landau
* Laplace
* Asymmetric
* Logistic
* Noncentral t
* Normal (Gaussian)
* Normal-inverse Gaussian
* Skew normal
* Slash
* Stable
* Student's t
* Tracy–Widom
* Variance-gamma
* Voigt

with support
whose type varies|

* Generalized chi-squared
* Generalized extreme value
* Generalized Pareto
* Marchenko–Pastur
* Kaniadakis κ-exponential
* Kaniadakis κ-Gamma
* Kaniadakis κ-Weibull
* Kaniadakis κ-Logistic
* Kaniadakis κ-Erlang
* q-exponential
* q-Gaussian
* q-Weibull
* Shifted log-logistic
* Tukey lambda

Mixed
univariate|

| continuous-
discrete|

* Rectified Gaussian

|

Multivariate
(joint)|

* Discrete:
* Ewens
* Multinomial
* Dirichlet
* Negative
* Continuous:
* Dirichlet
* Generalized
* Multivariate Laplace
* Multivariate normal
* Multivariate stable
* Multivariate t
* Normal-gamma
* Inverse
* Matrix-valued:
* LKJ
* Matrix beta
* Matrix normal
* Matrix t
* Matrix gamma
* Inverse
* Wishart
* Normal
* Inverse
* Normal-inverse
* Complex
* Uniform distribution on a Stiefel manifold

Directional|

Univariate (circular) directional
Circular uniform
Univariate von Mises
Wrapped normal
Wrapped Cauchy
Wrapped exponential
Wrapped asymmetric Laplace
Wrapped Lévy
Bivariate (spherical)
Kent
Bivariate (toroidal)
Bivariate von Mises
Multivariate
von Mises–Fisher
Bingham

Degenerate
and singular|

Degenerate
Dirac delta function
Singular
Cantor

Families|

* Circular
* Compound Poisson
* Elliptical
* Exponential
* Natural exponential
* Location–scale
* Maximum entropy
* Mixture
* Pearson
* Tweedie
* Wrapped

* Category
* Commons

* v
* t
* e

Statistics

* Outline
* Index

Descriptive statistics

| Continuous data|

| Center|

* Mean
* Arithmetic
* Arithmetic-Geometric
* Contraharmonic
* Cubic
* Generalized/power
* Geometric
* Harmonic
* Heronian
* Heinz
* Lehmer
* Median
* Mode

|

Dispersion|

* Average absolute deviation
* Coefficient of variation
* Interquartile range
* Percentile
* Range
* Standard deviation
* Variance

Shape|

* Central limit theorem
* Moments
* Kurtosis
* L-moments
* Skewness

Count data|

* Index of dispersion

Summary tables|

* Contingency table
* Frequency distribution
* Grouped data

Dependence|

* Partial correlation
* Pearson product-moment correlation
* Rank correlation
* Kendall's τ
* Spearman's ρ
* Scatter plot

Graphics|

* Bar chart
* Biplot
* Box plot
* Control chart
* Correlogram
* Fan chart
* Forest plot
* Histogram
* Pie chart
* Q–Q plot
* Radar chart
* Run chart
* Scatter plot
* Stem-and-leaf display
* Violin plot

Data collection

| Study design|

* Effect size
* Missing data
* Optimal design
* Population
* Replication
* Sample size determination
* Statistic
* Statistical power

|

Survey methodology|

* Sampling
* Cluster
* Stratified
* Opinion poll
* Questionnaire
* Standard error

Controlled experiments|

* Blocking
* Factorial experiment
* Interaction
* Random assignment
* Randomized controlled trial
* Randomized experiment
* Scientific control

Adaptive designs|

* Adaptive clinical trial
* Stochastic approximation
* Up-and-down designs

Observational studies|

* Cohort study
* Cross-sectional study
* Natural experiment
* Quasi-experiment

Statistical inference

| Statistical theory|

* Population
* Statistic
* Probability distribution
* Sampling distribution
* Order statistic
* Empirical distribution
* Density estimation
* Statistical model
* Model specification
* Lp space
* Parameter
* location
* scale
* shape
* Parametric family
* Likelihood (monotone)
* Location–scale family
* Exponential family
* Completeness
* Sufficiency
* Statistical functional
* Bootstrap
* U
* V
* Optimal decision
* loss function
* Efficiency
* Statistical distance
* divergence
* Asymptotics
* Robustness

|

Frequentist inference|

| Point estimation|

* Estimating equations
* Maximum likelihood
* Method of moments
* M-estimator
* Minimum distance
* Unbiased estimators
* Mean-unbiased minimum-variance
* Rao–Blackwellization
* Lehmann–Scheffé theorem
* Median unbiased
* Plug-in

|

Interval estimation|

* Confidence interval
* Pivot
* Likelihood interval
* Prediction interval
* Tolerance interval
* Resampling
* Bootstrap
* Jackknife

Testing hypotheses|

* 1- & 2-tails
* Power
* Uniformly most powerful test
* Permutation test
* Randomization test
* Multiple comparisons

Parametric tests|

* Likelihood-ratio
* Score/Lagrange multiplier
* Wald

Specific tests|

* Z-test (normal)
* Student's t-test
* F-test

Goodness of fit|

* Chi-squared
* G-test
* Kolmogorov–Smirnov
* Anderson–Darling
* Lilliefors
* Jarque–Bera
* Normality (Shapiro–Wilk)
* Likelihood-ratio test
* Model selection
* Cross validation
* AIC
* BIC

Rank statistics|

* Sign
* Sample median
* Signed rank (Wilcoxon)
* Hodges–Lehmann estimator
* Rank sum (Mann–Whitney)
* Nonparametric anova
* 1-way (Kruskal–Wallis)
* 2-way (Friedman)
* Ordered alternative (Jonckheere–Terpstra)
* Van der Waerden test

Bayesian inference|

* Bayesian probability
* prior
* posterior
* Credible interval
* Bayes factor
* Bayesian estimator
* Maximum posterior estimator

* Correlation
* Regression analysis

| Correlation|

* Pearson product-moment
* Partial correlation
* Confounding variable
* Coefficient of determination

|

Regression analysis|

* Errors and residuals
* Regression validation
* Mixed effects models
* Simultaneous equations models
* Multivariate adaptive regression splines (MARS)

Linear regression|

* Simple linear regression
* Ordinary least squares
* General linear model
* Bayesian regression

Non-standard predictors|

* Nonlinear regression
* Nonparametric
* Semiparametric
* Isotonic
* Robust
* Homoscedasticity and Heteroscedasticity

Generalized linear model|

* Exponential families
* Logistic (Bernoulli) / Binomial / Poisson regressions

Partition of variance|

* Analysis of variance (ANOVA, anova)
* Analysis of covariance
* Multivariate ANOVA
* Degrees of freedom

Categorical / multivariate / time-series / survival analysis

| Categorical|

* Cohen's kappa
* Contingency table
* Graphical model
* Log-linear model
* McNemar's test
* Cochran–Mantel–Haenszel statistics

|

Multivariate|

* Regression
* Manova
* Principal components
* Canonical correlation
* Discriminant analysis
* Cluster analysis
* Classification
* Structural equation model
* Factor analysis
* Multivariate distributions
* Elliptical distributions
* Normal

Time-series|

| General|

* Decomposition
* Trend
* Stationarity
* Seasonal adjustment
* Exponential smoothing
* Cointegration
* Structural break
* Granger causality

|

Specific tests|

* Dickey–Fuller
* Johansen
* Q-statistic (Ljung–Box)
* Durbin–Watson
* Breusch–Godfrey

Time domain|

* Autocorrelation (ACF)
* partial (PACF)
* Cross-correlation (XCF)
* ARMA model
* ARIMA model (Box–Jenkins)
* Autoregressive conditional heteroskedasticity (ARCH)
* Vector autoregression (VAR)

Frequency domain|

* Spectral density estimation
* Fourier analysis
* Least-squares spectral analysis
* Wavelet
* Whittle likelihood

Survival|

| Survival function|

* Kaplan–Meier estimator (product limit)
* Proportional hazards models
* Accelerated failure time (AFT) model
* First hitting time

|

Hazard function|

* Nelson–Aalen estimator

Test|

* Log-rank test

Applications

| Biostatistics|

* Bioinformatics
* Clinical trials / studies
* Epidemiology
* Medical statistics

|

Engineering statistics|

* Chemometrics
* Methods engineering
* Probabilistic design
* Process / quality control
* Reliability
* System identification

Social statistics|

* Actuarial science
* Census
* Crime statistics
* Demography
* Econometrics
* Jurimetrics
* National accounts
* Official statistics
* Population statistics
* Psychometrics

Spatial statistics|

* Cartography
* Environmental statistics
* Geographic information system
* Geostatistics
* Kriging

* Category
* Mathematics portal
* Commons
* WikiProject

*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template