Krylov subspace

Short description: Linear subspace generated from a vector acted on by a power series of a matrix

In linear algebra, the order-r Krylov subspace generated by an n-by-n matrix A and a vector b of dimension n is the linear subspace spanned by the images of b under the first r powers of A (starting from A0=I), that is,[1][2]

𝒦r(A,b)=span⁡{b,Ab,A2b,…,Ar−1b}.

## Contents

* 1 Background
* 2 Properties
* 3 Use
* 4 Issues
* 5 Existing methods
* 6 See also
* 7 References
* 8 Further reading

## Background

The concept is named after Russian applied mathematician and naval engineer Alexei Krylov, who published a paper about the concept in 1931.[3]

## Properties

* 𝒦r(A,b),A𝒦r(A,b)⊂𝒦r+1(A,b).
* Let r0=dim⁡span⁡{b,Ab,A2b,…}. Then {b,Ab,A2b,…,Ar−1b} are linearly independent unless r>r0, 𝒦r(A,b)⊂𝒦r0(A,b) for all r, and dim⁡𝒦r0(A,b)=r0. So r0 is the maximal dimension of the Krylov subspaces 𝒦r(A,b).
* The maximal dimension satisfies r0≤1+rank⁡A and r0≤n.
* Consider dim⁡span⁡{I,A,A2,…}=deg⁡p(A), where p(A) is the minimal polynomial of A. We have r0≤deg⁡p(A). Moreover, for any A, there exists a b for which this bound is tight, i.e. r0=deg⁡p(A).
* 𝒦r(A,b) is a cyclic submodule generated by b of the torsion k[x]-module (kn)A, where kn is the linear space on k.
* kn can be decomposed as the direct sum of Krylov subspaces.[clarification needed]

## Use

Krylov subspaces are used in algorithms for finding approximate solutions to high-dimensional linear algebra problems.[2] Many linear dynamical system tests in control theory, especially those related to controllability and observability, involve checking the rank of the Krylov subspace. These tests are equivalent to finding the span of the Gramians associated with the system/output maps so the uncontrollable and unobservable subspaces are simply the orthogonal complement to the Krylov subspace.[4]

Modern iterative methods such as Arnoldi iteration can be used for finding one (or a few) eigenvalues of large sparse matrices or solving large systems of linear equations. They try to avoid matrix-matrix operations, but rather multiply vectors by the matrix and work with the resulting vectors. Starting with a vector b, one computes Ab, then one multiplies that vector by A to find A2b and so on. All algorithms that work this way are referred to as Krylov subspace methods; they are among the most successful methods currently available in numerical linear algebra. These methods can be used in situations where there is an algorithm to compute the matrix-vector multiplication without there being an explicit representation of A, giving rise to matrix-free methods.

## Issues

Because the vectors usually soon become almost linearly dependent due to the properties of power iteration, methods relying on Krylov subspace frequently involve some orthogonalization scheme, such as Lanczos iteration for Hermitian matrices or Arnoldi iteration for more general matrices.

## Existing methods

The best known Krylov subspace methods are the Conjugate gradient, IDR(s) (Induced dimension reduction), GMRES (generalized minimum residual), BiCGSTAB (biconjugate gradient stabilized), QMR (quasi minimal residual), TFQMR (transpose-free QMR) and MINRES (minimal residual method).

## See also

* Iterative method, which has a section on Krylov subspace methods

## References

1. ↑ Nocedal, Jorge; Wright, Stephen J. (2006). Numerical optimization. Springer series in operation research and financial engineering (2nd ed.). New York, NY: Springer. pp. 108. ISBN 978-0-387-30303-1.
2. ↑ 2.0 2.1 Simoncini, Valeria (2015), Nicholas J. Higham, ed., Krylov Subspaces, Princeton University Press, pp. 113–114
3. ↑ Krylov, A. N. (1931). "О численном решении уравнения, которым в технических вопросах определяются частоты малых колебаний материальных систем" (in ru). Izvestiia Akademii Nauk SSSR 7 (4): 491–539. http://mi.mathnet.ru/eng/izv/y1931/i4/p491.
4. ↑ Hespanha, Joao (2017), Linear Systems Theory, Princeton University Press

## Further reading

* Nevanlinna, Olavi (1993). Convergence of iterations for linear equations. Lectures in Mathematics ETH Zürich. Basel: Birkhäuser Verlag. pp. viii+177 pp. ISBN 3-7643-2865-7.
* Saad, Yousef (2003). Iterative methods for sparse linear systems (2nd ed.). SIAM. ISBN 0-89871-534-2. OCLC 51266114. https://archive.org/details/iterativemethods0000saad.
* Charles George Broyden and Maria Teresa Vespucci(2004): Krylov Solvers for Linear Algebraic Systems, Elsevier(Studies in Computational Mathematics 11), ISBN 0-444-51474-0.
* Meurant, Gérard; Duintjer Tebbens, Jurjen (2020). Krylov Methods for Nonsymmetric Linear Systems: From Theory to Computations. 57. Cham: Springer International Publishing. doi:10.1007/978-3-030-55251-0. ISBN 978-3-030-55250-3.
* Iman Farahbakhsh: Krylov Subspace Methods with Application in Incompressible Fluid Flow Solvers, Wiley, ISBN 978-1119618683 (Sep., 2020).

* v
* t
* e

Numerical linear algebra

Key concepts|

* Floating point
* Numerical stability

Problems|

* System of linear equations
* Matrix decompositions
* Matrix multiplication (algorithms)
* Matrix splitting
* Sparse problems

Hardware|

* CPU cache
* TLB
* Cache-oblivious algorithm
* SIMD
* Multiprocessing

Software|

* MATLAB
* Basic Linear Algebra Subprograms (BLAS)
* LAPACK
* Specialized libraries
* General purpose software

0.00

(0 votes)

Original source: https://en.wikipedia.org/wiki/Krylov subspace. Read more

|

Retrieved from "https://handwiki.org/wiki/index.php?title=Krylov_subspace&oldid=4158313"
*[v]: View this template
*[t]: Discuss this template
*[e]: Edit this template