The Fourier transform has been used for over a century as a way of decomposing and expanding signals. However, the Fourier transform masks key information regarding the moment of emission and the duration of a signal. In 1946, Dennis Gabor was able to solve this using a technique that simultaneously reduced noise, provided resiliency, and created quantization while encapsulating important signal characteristics.[1] This discovery marked the first concerted effort towards frame theory.
Suppose we have a vector space over a field and we want to express an arbitrary element as a linear combination of the vectors , that is, finding coefficients such that
If the set does not span, then such coefficients do not exist for every such . If spans and also is linearly independent, this set forms a basis of , and the coefficients are uniquely determined by . If, however, spans but is not linearly independent, the question of how to determine the coefficients becomes less apparent, in particular if is of infinite dimension.
Given that spans and is linearly dependent, one strategy is to remove vectors from the set until it becomes linearly independent and forms a basis. There are some problems with this plan:
Removing arbitrary vectors from the set may cause it to be unable to span before it becomes linearly independent.
Even if it is possible to devise a specific way to remove vectors from the set until it becomes a basis, this approach may become unfeasible in practice if the set is large or infinite.
In some applications, it may be an advantage to use more vectors than necessary to represent . This means that we want to find the coefficients without removing elements in . The coefficients will no longer be uniquely determined by . Therefore, the vector can be represented as a linear combination of in more than one way.
Let be an inner product space and be a set of vectors in . The set is a frame of if it satisfies the so called frame condition. That is, if there exist two constants such that[5]
A frame is called overcomplete (or redundant) if it is not a Riesz basis for the vector space. The redundancy of the frame is measured by the lower and upper frame bounds (or redundancy factors) and , respectively.[6]
That is, a frame of normalized vectors in an -dimensional space has frame bounds which satisfiy
The frame bounds are not unique because numbers less than and greater than are also valid frame bounds. The optimal lower bound is the supremum of all lower bounds and the optimal upper bound is the infimum of all upper bounds.
The composition of the analysis operator and the synthesis operator leads to the frame operator defined as
From this definition and linearity in the first argument of the inner product, the frame condition now yields
If the analysis operator exists, then so does the frame operator as well as the inverse . Both and are positive definite, bounded self-adjoint operators, resulting in and being the infimum and supremum values of the spectrum of .[9] In finite dimensions, the frame operator is automatically trace-class, with and corresponding to the smallest and largest eigenvalues of or, equivalently, the smallest and largest singular values of .[10]
The frame condition is a generalization of Parseval's identity that maintains norm equivalence between a signal in and its sequence of coefficients in .
If the set is a frame of , it spans. Otherwise there would exist at least one non-zero which would be orthogonal to all such that
either violating the frame condition or the assumption that .
However, a spanning set of is not necessarily a frame. For example, consider with the dot product, and the infinite set given by
This set spans but since
we cannot choose a finite upper frame bound B. Consequently, the set is not a frame.
Let be a frame; satisfying the frame condition. Then the dual operator is defined as
with
called the dual frame (or conjugate frame). It is the canonical dual of (similar to a dual basis of a basis), with the property that[11]
and subsequent frame condition
Canonical duality is a reciprocity relation, i.e. if the frame is the canonical dual of then the frame is the canonical dual of To see that this makes sense, let be an element of and let
Thus
proving that
Alternatively, let
Applying the properties of and its inverse then shows that
and therefore
An overcomplete frame allows us some freedom for the choice of coefficients such that . That is, there exist dual frames of for which
Suppose is a subspace of a Hilbert space and let and be a frame and dual frame of , respectively. If does not depend on , the dual frame is computed as
where denotes the restriction of to such that is invertible on . The best linear approximation of in is then given by the orthogonal projection of onto, defined as
The dual frame synthesis operator is defined as
and the orthogonal projection is computed from the frame coefficients . In dual analysis, the orthogonal projection is computed from as
In signal processing, it is common to represent signals as vectors in a Hilbert space. In this interpretation, a vector expressed as a linear combination of the frame vectors is a redundant signal. Representing a signal strictly with a set of linearly independent vectors may not always be the most compact form.[13] Using a frame, it is possible to create a simpler, more sparse representation of a signal as compared with a family of elementary signals. Frames, therefore, provide "robustness". Because they provide a way of producing the same vector within a space, signals can be encoded in various ways. This facilitates fault tolerance and resilience to a loss of signal. Finally, redundancy can be used to mitigate noise, which is relevant to the restoration, enhancement, and reconstruction of signals.
The system remains stable under "sufficiently small" perturbations and the frame will form a Riesz basis for . Accordingly, every function in will have a unique non-harmonic Fourier series representation
with and is called the Fourier frame (or frame of exponentials). What constitutes "sufficiently small" is described by the following theorem, named after Mikhail Kadets.[15]
Kadec's 1⁄4-theorem — Let be a sequence of real numbers such that
Redundancy of a frame is useful in mitigating added noise from the frame coefficients. Let denote a vector computed with noisy frame coefficients. The noise is then mitigated by projecting onto the image of .
The coefficients are frame coefficients in if and only if
The sequence space and (as ) are reproducing kernel Hilbert spaces with a kernel given by the matrix .[9] As such, the above equation is also referred to as the reproducing kernel equation and expresses the redundancy of frame coefficients.[18]
A frame is a tight frame if . A tight frame with frame bound has the property that
For example, the union of disjoint orthonormal bases of a vector space is an overcomplete tight frame with . A tight frame is a Parseval frame if .[19] Each orthonormal basis is a (complete) Parseval frame, but the converse is not necessarily true.[20]
A frame is an equal norm frame if there is a constant such that for each . An equal norm frame is a normalized frame (sometimes called a unit-norm frame) if .[21] A unit-norm Parseval frame is an orthonormal basis; such a frame satisfies Parseval's identity.
A frame is an exact frame if no proper subset of the frame spans the inner product space. Each basis for an inner product space is an exact frame for the space (so a basis is a special case of a frame).
Sometimes it may not be possible to satisfy both frame bounds simultaneously. An upper (respectively lower) semi-frame is a set that only satisfies the upper (respectively lower) frame inequality.[9] The Bessel Sequence is an example of a set of vectors that satisfies only the upper frame inequality.
For any vector to be reconstructed from the coefficients it suffices if there exists a constant such that
By setting and applying the linearity of the analysis operator, this condition is equivalent to:
A fusion frame is best understood as an extension of the dual frame synthesis and analysis operators where, instead of a single subspace , a set of closed subspaces with positive scalar weights is considered. A fusion frame is a family that satisfies the frame condition
where denotes the orthogonal projection onto the subspace .[23]
Suppose is a Hilbert space, a locally compact space, and is a locally finite Borel measure on . Then a set of vectors in , with a measure is said to be a continuous frame if there exists constants, such that
To see that continuous frames are indeed the natural generalization of the frames mentioned above, consider a discrete set and a measure where is the Dirac measure. Then the continuous frame condition reduces to
Just like in the discrete case we can define the analysis, synthesis, and frame operators when dealing with continuous frames.
The composition of the continuous analysis operator and the continuous synthesis operator is known as the continuous frame operator. For a continuous frame , it is defined as follows:
by
In this case, the continuous frame projector is the orthogonal projection defined by
Given a continuous frame , and another continuous frame , then is said to be a continuous dual frame of if it satisfies the following condition for all :