Prediction interval

Short description: Estimate of an interval in which future observations will fall

In statistical inference, specifically predictive inference, a prediction interval is an estimate of an interval in which a future observation will fall, with a certain probability, given what has already been observed. Prediction intervals are often used in regression analysis.

A simple example is given by a six-sided die with face values ranging from 1 to 6. The confidence interval for the estimated expected value of the face value will be around 3.5 and will become narrower with a larger sample size. However, the prediction interval for the next roll will approximately range from 1 to 6, even with any number of samples seen so far.

Prediction intervals are used in both frequentist statistics and Bayesian statistics: a prediction interval bears the same relationship to a future observation that a frequentist confidence interval or Bayesian credible interval bears to an unobservable population parameter: prediction intervals predict the distribution of individual future points, whereas confidence intervals and credible intervals of parameters predict the distribution of estimates of the true population mean or other quantity of interest that cannot be observed.

## Contents

* 1 Introduction
* 2 Normal distribution
* 2.1 Known mean, known variance
* 2.2 Estimation of parameters
* 2.2.1 Unknown mean, known variance
* 2.2.2 Known mean, unknown variance
* 2.2.3 Unknown mean, unknown variance
* 3 Non-parametric methods
* 3.1 Conformal Prediction
* 4 Contrast with other intervals
* 4.1 Contrast with confidence intervals
* 5 In regression analysis
* 6 Bayesian statistics
* 7 Applications
* 8 See also
* 9 Notes
* 10 References
* 11 Further reading

## Introduction

If one makes the parametric assumption that the underlying distribution is a normal distribution, and has a sample set {X1, ..., Xn}, then confidence intervals and credible intervals may be used to estimate the population mean μ and population standard deviation σ of the underlying population, while prediction intervals may be used to estimate the value of the next sample variable, Xn+1.

Alternatively, in Bayesian terms, a prediction interval can be described as a credible interval for the variable itself, rather than for a parameter of the distribution thereof.

The concept of prediction intervals need not be restricted to inference about a single future sample value but can be extended to more complicated cases. For example, in the context of river flooding where analyses are often based on annual values of the largest flow within the year, there may be interest in making inferences about the largest flood likely to be experienced within the next 50 years.

Since prediction intervals are only concerned with past and future observations, rather than unobservable population parameters, they are advocated as a better method than confidence intervals by some statisticians, such as Seymour Geisser,[citation needed] following the focus on observables by Bruno de Finetti.[citation needed]

## Normal distribution

Given a sample from a normal distribution, whose parameters are unknown, it is possible to give prediction intervals in the frequentist sense, i.e., an interval [a, b] based on statistics of the sample such that on repeated experiments, Xn+1 falls in the interval the desired percentage of the time; one may call these "predictive confidence intervals".[1]

A general technique of frequentist prediction intervals is to find and compute a pivotal quantity of the observables X1, ..., Xn, Xn+1 – meaning a function of observables and parameters whose probability distribution does not depend on the parameters – that can be inverted to give a probability of the future observation Xn+1 falling in some interval computed in terms of the observed values so far, X1,…,Xn. Such a pivotal quantity, depending only on observables, is called an ancillary statistic.[2] The usual method of constructing pivotal quantities is to take the difference of two variables that depend on location, so that location cancels out, and then take the ratio of two variables that depend on scale, so that scale cancels out. The most familiar pivotal quantity is the Student's t-statistic, which can be derived by this method and is used in the sequel.

### Known mean, known variance

A prediction interval [ℓ,u] for a future observation X in a normal distribution N(µ,σ2) with known mean and variance may be calculated from

γ=P(ℓ<X<u)=P(ℓ−μσ<X−μσ<u−μσ)=P(ℓ−μσ<Z<u−μσ),

where Z=X−μσ, the standard score of X, is distributed as standard normal.

Hence

ℓ−μσ=−z,u−μσ=z,

ℓ=μ−zσ,u=μ+zσ,

with z the quantile in the standard normal distribution for which:

γ=P(−z<Z<z).

or equivalently;

12(1−γ)=P(Z>z).
Prediction
interval | z

|

75% | 1.15[3]
90% | 1.64[3]
95% | 1.96[3]
99% | 2.58[3]
Prediction interval (on the y-axis) given from z (the quantile of the standard score, on the x-axis). The y-axis is logarithmically compressed (but the values on it are not modified).

The prediction interval is conventionally written as:

[μ−zσ, μ+zσ].

For example, to calculate the 95% prediction interval for a normal distribution with a mean (µ) of 5 and a standard deviation (σ) of 1, then z is approximately 2. Therefore, the lower limit of the prediction interval is approximately 5 ‒ (2*1) = 3, and the upper limit is approximately 5 + (2*1) = 7, thus giving a prediction interval of approximately 3 to 7.

Diagram showing the cumulative distribution function for the normal distribution with mean (µ) 0 and variance (σ2) 1\. In addition to the quantile function, the prediction interval for any standard score can be calculated by (1 − (1 − Φµ,σ2(standard score))*2). For example, a standard score of x = 1.96 gives Φµ,σ2(1.96) = 0.9750 corresponding to a prediction interval of (1 − (1 − 0.9750)*2) = 0.9500 = 95%.

### Estimation of parameters

For a distribution with unknown parameters, a direct approach to prediction is to estimate the parameters and then use the associated quantile function – for example, one could use the sample mean X‾ as estimate for μ and the sample variance s2 as an estimate for σ2. There are two natural choices for s2 here – dividing by (n−1) yields an unbiased estimate, while dividing by n yields the maximum likelihood estimator, and either might be used. One then uses the quantile function with these estimated parameters ΦX‾,s2−1 to give a prediction interval.

This approach is usable, but the resulting interval will not have the repeated sampling interpretation[4] – it is not a predictive confidence interval.

For the sequel, use the sample mean:

X‾=X‾n=(X1+⋯+Xn)/n

and the (unbiased) sample variance:

s2=sn2=1n−1∑i=1n(Xi−X‾n)2

#### Unknown mean, known variance

Given[5] a normal distribution with unknown mean μ but known variance 1, the sample mean X‾ of the observations X1,…,Xn has distribution N(μ,1/n), while the future observation Xn+1 has distribution N(μ,1). Taking the difference of these cancels the μ and yields a normal distribution of variance 1+(1/n), thus

Xn+1−X‾1+(1/n)∼N(0,1).

Solving for Xn+1 gives the prediction distribution N(X‾,1+(1/n)), from which one can compute intervals as before. This is a predictive confidence interval in the sense that if one uses a quantile range of 100p%, then on repeated applications of this computation, the future observation Xn+1 will fall in the predicted interval 100p% of the time.

Notice that this prediction distribution is more conservative than using the estimated mean X‾ and known variance 1, as this uses variance 1+(1/n), hence yields wider intervals. This is necessary for the desired confidence interval property to hold.

#### Known mean, unknown variance

Conversely, given a normal distribution with known mean 0 but unknown variance σ2, the sample variance s2 of the observations X1,…,Xn has, up to scale, a χn−12 distribution; more precisely:

(n−1)sn2σ2∼χn−12.

while the future observation Xn+1 has distribution N(0,σ2). Taking the ratio of the future observation and the sample standard deviation [clarification needed] cancels the σ, yielding a Student's t-distribution with n – 1 degrees of freedom:

Xn+1s∼Tn−1.

Solving for Xn+1 gives the prediction distribution sTn−1, from which one can compute intervals as before.

Notice that this prediction distribution is more conservative than using a normal distribution with the estimated standard deviation s and known mean 0, as it uses the t-distribution instead of the normal distribution, hence yields wider intervals. This is necessary for the desired confidence interval property to hold.

#### Unknown mean, unknown variance

Combining the above for a normal distribution N(μ,σ2) with both μ and σ2 unknown yields the following ancillary statistic:[6]

Xn+1−X‾nsn1+1/n∼Tn−1

This simple combination is possible because the sample mean and sample variance of the normal distribution are independent statistics; this is only true for the normal distribution, and in fact characterizes the normal distribution.

Solving for Xn+1 yields the prediction distribution

X‾n+sn1+1/n⋅Tn−1

The probability of Xn+1 falling in a given interval is then:

Pr⁡(X‾n−Tasn1+(1/n)≤Xn+1≤X‾n+Tasn1+(1/n))=p

where Ta is the 100((1 − p)/2)th percentile of Student's t-distribution with n − 1 degrees of freedom. Therefore, the numbers

X‾n±Tasn1+(1/n)

are the endpoints of a 100(1 − p)% prediction interval for Xn+1.

## Non-parametric methods

One can compute prediction intervals without any assumptions on the population, i.e. in a non-parametric way.

The residual bootstrap method can be used for constructing non-parametric prediction intervals.

### Conformal Prediction

In general the conformal prediction method is more general. Let us look at the special case of using the minimum and maximum as boundaries for a prediction interval: If one has a sample of identical random variables {X1, ..., Xn}, then the probability that the next observation Xn+1 will be the largest is 1/(n + 1), since all observations have equal probability of being the maximum. In the same way, the probability that Xn+1 will be the smallest is 1/(n + 1). The other (n − 1)/(n + 1) of the time, Xn+1 falls between the sample maximum and sample minimum of the sample {X1, ..., Xn}. Thus, denoting the sample maximum and minimum by M and m, this yields an (n − 1)/(n + 1) prediction interval of [m, M].

Notice that while this gives the probability that a future observation will fall in a range, it does not give any estimate as to where in a segment it will fall – notably, if it falls outside the range of observed values, it may be far outside the range. See extreme value theory for further discussion. Formally, this applies not just to sampling from a population, but to any exchangeable sequence of random variables, not necessarily independent or identically distributed.

## Contrast with other intervals

### Contrast with confidence intervals

In the formula for the predictive confidence interval no mention is made of the unobservable parameters μ and σ of population mean and standard deviation – the observed sample statistics X‾n and Sn of sample mean and standard deviation are used, and what is estimated is the outcome of future samples.

Rather than using sample statistics as estimators of population parameters and applying confidence intervals to these estimates, one considers "the next sample" Xn+1 as itself a statistic, and computes its sampling distribution.

In parameter confidence intervals, one estimates population parameters; if one wishes to interpret this as prediction of the next sample, one models "the next sample" as a draw from this estimated population, using the (estimated) population distribution. By contrast, in predictive confidence intervals, one uses the sampling distribution of (a statistic of) a sample of n or n + 1 observations from such a population, and the population distribution is not directly used, though the assumption about its form (though not the values of its parameters) is used in computing the sampling distribution.

## In regression analysis

A common application of prediction intervals is to regression analysis.

Suppose the data is being modeled by a straight line regression:

yi=α+βxi+εi

where yi is the response variable, xi is the explanatory variable, εi is a random error term, and α and β are parameters.

Given estimates α^ and β^ for the parameters, such as from a simple linear regression, the predicted response value yd for a given explanatory value xd is

y^d=α^+β^xd,

(the point on the regression line), while the actual response would be

yd=α+βxd+εd.

The point estimate y^d is called the mean response, and is an estimate of the expected value of yd, E(y∣xd).

A prediction interval instead gives an interval in which one expects yd to fall; this is not necessary if the actual parameters α and β are known (together with the error term εi), but if one is estimating from a sample, then one may use the standard error of the estimates for the intercept and slope (α^ and β^), as well as their correlation, to compute a prediction interval.

In regression, (Faraway 2002) makes a distinction between intervals for predictions of the mean response vs. for predictions of observed response—affecting essentially the inclusion or not of the unity term within the square root in the expansion factors above; for details, see (Faraway 2002).

## Bayesian statistics

Seymour Geisser, a proponent of predictive inference, gives predictive applications of Bayesian statistics.[7]

In Bayesian statistics, one can compute (Bayesian) prediction intervals from the posterior probability of the random variable, as a credible interval. In theoretical work, credible intervals are not often calculated for the prediction of future events, but for inference of parameters – i.e., credible intervals of a parameter, not for the outcomes of the variable itself. However, particularly where applications are concerned with possible extreme values of yet to be observed cases, credible intervals for such values can be of practical importance.

## Applications

Prediction intervals are commonly used as definitions of reference ranges, such as reference ranges for blood tests to give an idea of whether a blood test is normal or not. For this purpose, the most commonly used prediction interval is the 95% prediction interval, and a reference range based on it can be called a standard reference range.

## See also

* Extrapolation
* Posterior probability
* Prediction
* Prediction band
* Seymour Geisser
* Statistical model validation
* Trend estimation

## Notes

1. ↑ (Geisser 1993): Chapter 2: Non-Bayesian predictive approaches
2. ↑ (Geisser 1993)
3. ↑ 3.0 3.1 3.2 3.3 Table A2 in (Sterne Kirkwood)
4. ↑ (Geisser 1993)
5. ↑ (Geisser 1993)
6. ↑ (Geisser 1993)
7. ↑ (Geisser 1993)

## References

* Faraway, Julian J. (2002), Practical Regression and Anova using R, https://cran.r-project.org/doc/contrib/Faraway-PRA.pdf
* Predictive Inference, CRC Press, 1993
* Sterne, Jonathan; Kirkwood, Betty R. (2003), Essential Medical Statistics, Blackwell Science, ISBN 0-86542-871-9, https://archive.org/details/essentialmedical00kirk

## Further reading

* Chatfield, C. (1993). "Calculating Interval Forecasts". Journal of Business & Economic Statistics 11 (2): 121–135. doi:10.2307/1391361.
* Lawless, J. F.; Fredette, M. (2005). "Frequentist prediction intervals and predictive distributions". Biometrika 92 (3): 529–542. doi:10.1093/biomet/92.3.529.
* Meade, N.; Islam, T. (1995). "Prediction Intervals for Growth Curve Forecasts". Journal of Forecasting 14 (5): 413–430. doi:10.1002/for.3980140502.
* ISO 16269-8 Standard Interpretation of Data, Part 8, Determination of Prediction Intervals

* v
* t
* e

Statistics

* Outline
* Index

Descriptive statistics

| Continuous data|

| Center|

* Mean
* arithmetic
* geometric
* harmonic
* Median
* Mode

|

Dispersion|

* Variance
* Standard deviation
* Coefficient of variation
* Percentile
* Range
* Interquartile range

Shape|

* Central limit theorem
* Moments
* Skewness
* Kurtosis
* L-moments

Count data|

* Index of dispersion

Summary tables|

* Grouped data
* Frequency distribution
* Contingency table

Dependence|

* Pearson product-moment correlation
* Rank correlation
* Spearman's rho
* Kendall's tau
* Partial correlation
* Scatter plot

Graphics|

* Bar chart
* Biplot
* Box plot
* Control chart
* Correlogram
* Fan chart
* Forest plot
* Histogram
* Pie chart
* Q–Q plot
* Run chart
* Scatter plot
* Stem-and-leaf display
* Radar chart
* Violin plot

Data collection

| Study design|

* Population
* Statistic
* Effect size
* Statistical power
* Optimal design
* Sample size determination
* Replication
* Missing data

|

Survey methodology|

* Sampling
* stratified
* cluster
* Standard error
* Opinion poll
* Questionnaire

Controlled experiments|

* Scientific control
* Randomized experiment
* Randomized controlled trial
* Random assignment
* Blocking
* Interaction
* Factorial experiment

Adaptive Designs|

* Adaptive clinical trial
* Up-and-Down Designs
* Stochastic approximation

Observational Studies|

* Cross-sectional study
* Cohort study
* Natural experiment
* Quasi-experiment

Statistical inference

| Statistical theory|

* Population
* Statistic
* Probability distribution
* Sampling distribution
* Order statistic
* Empirical distribution
* Density estimation
* Statistical model
* Model specification
* Lp space
* Parameter
* location
* scale
* shape
* Parametric family
* Likelihood (monotone)
* Location–scale family
* Exponential family
* Completeness
* Sufficiency
* Statistical functional
* Bootstrap
* U
* V
* Optimal decision
* loss function
* Efficiency
* Statistical distance
* divergence
* Asymptotics
* Robustness

|

Frequentist inference|

| Point estimation|

* Estimating equations
* Maximum likelihood
* Method of moments
* M-estimator
* Minimum distance
* Unbiased estimators
* Mean-unbiased minimum-variance
* Rao–Blackwellization
* Lehmann–Scheffé theorem
* Median unbiased
* Plug-in

|

Interval estimation|

* Confidence interval
* Pivot
* Likelihood interval
* Prediction interval
* Tolerance interval
* Resampling
* Bootstrap
* Jackknife

Testing hypotheses|

* 1- & 2-tails
* Power
* Uniformly most powerful test
* Permutation test
* Randomization test
* Multiple comparisons

Parametric tests|

* Likelihood-ratio
* Score/Lagrange multiplier
* Wald

Specific tests|

* Z-test (normal)
* Student's t-test
* F-test

Goodness of fit|

* Chi-squared
* G-test
* Kolmogorov–Smirnov
* Anderson–Darling
* Lilliefors
* Jarque–Bera
* Normality (Shapiro–Wilk)
* Likelihood-ratio test
* Model selection
* Cross validation
* AIC
* BIC

Rank statistics|

* Sign
* Sample median
* Signed rank (Wilcoxon)
* Hodges–Lehmann estimator
* Rank sum (Mann–Whitney)
* Nonparametric anova
* 1-way (Kruskal–Wallis)
* 2-way (Friedman)
* Ordered alternative (Jonckheere–Terpstra)

Bayesian inference|

* Bayesian probability
* prior
* posterior
* Credible interval
* Bayes factor
* Bayesian estimator
* Maximum posterior estimator

* Correlation
* Regression analysis

| Correlation|

* Pearson product-moment
* Partial correlation
* Confounding variable
* Coefficient of determination

|

Regression analysis|

* Errors and residuals
* Regression validation
* Mixed effects models
* Simultaneous equations models
* Multivariate adaptive regression splines (MARS)

Linear regression|

* Simple linear regression
* Ordinary least squares
* General linear model
* Bayesian regression

Non-standard predictors|

* Nonlinear regression
* Nonparametric
* Semiparametric
* Isotonic
* Robust
* Heteroscedasticity
* Homoscedasticity

Generalized linear model|

* Exponential families
* Logistic (Bernoulli) / Binomial / Poisson regressions

Partition of variance|

* Analysis of variance (ANOVA, anova)
* Analysis of covariance
* Multivariate ANOVA
* Degrees of freedom

Categorical / Multivariate / Time-series / Survival analysis

| Categorical|

* Cohen's kappa
* Contingency table
* Graphical model
* Log-linear model
* McNemar's test

|

Multivariate|

* Regression
* Manova
* Principal components
* Canonical correlation
* Discriminant analysis
* Cluster analysis
* Classification
* Structural equation model
* Factor analysis
* Multivariate distributions
* Elliptical distributions
* Normal

Time-series|

| General|

* Decomposition
* Trend
* Stationarity
* Seasonal adjustment
* Exponential smoothing
* Cointegration
* Structural break
* Granger causality

|

Specific tests|

* Dickey–Fuller
* Johansen
* Q-statistic (Ljung–Box)
* Durbin–Watson
* Breusch–Godfrey

Time domain|

* Autocorrelation (ACF)
* partial (PACF)
* Cross-correlation (XCF)
* ARMA model
* ARIMA model (Box–Jenkins)
* Autoregressive conditional heteroskedasticity (ARCH)
* Vector autoregression (VAR)

Frequency domain|

* Spectral density estimation
* Fourier analysis
* Wavelet
* Whittle likelihood

Survival|

| Survival function|

* Kaplan–Meier estimator (product limit)
* Proportional hazards models
* Accelerated failure time (AFT) model
* First hitting time

|

Hazard function|

* Nelson–Aalen estimator

Test|

* Log-rank test

Applications

| Biostatistics|

* Bioinformatics
* Clinical trials / studies
* Epidemiology
* Medical statistics

|

Engineering statistics|

* Chemometrics
* Methods engineering
* Probabilistic design
* Process / quality control
* Reliability
* System identification

Social statistics|

* Actuarial science
* Census
* Crime statistics
* Demography
* Econometrics
* Jurimetrics
* National accounts
* Official statistics
* Population statistics
* Psychometrics

Spatial statistics|

* Cartography
* Environmental statistics
* Geographic information system
* Geostatistics
* Kriging

* Category
* '
* Commons
* WikiProject

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Prediction interval. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Prediction_interval&oldid=236204"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template