TOPICS
Search

Fixed Point Iteration


A fixed point iteration is an iterative method for approximating a fixed point p of a map g. Starting from an initial value x_0, it forms the sequence

 x_(n+1)=g(x_n),
(1)

for n=0, 1, 2, .... The method is also called the method of successive approximations and, in several settings, Picard iteration. If the sequence converges to p and g is continuous at p, then taking the limit in the iteration gives p=g(p). Convergence is not automatic and can depend strongly on both the map and the initial value.

Suppose (X,d) is a complete metric space and g:X->X is a contraction. If there is a constant q with 0<=q<1 such that

 d(g(x),g(y))<=qd(x,y),
(2)

for all x,y in X, the Banach fixed point theorem states that g has a unique fixed point p and that the fixed point iteration converges to p for every x_0 in X (Banach 1922). It also gives the a priori error bound

 d(x_n,p)<=q^nd(x_0,p)<=(q^n)/(1-q)d(x_1,x_0).
(3)

For n>=1, an a posteriori error bound is

 d(x_n,p)<=q/(1-q)d(x_n,x_(n-1)).
(4)

For a differentiable real function or complex function, a fixed point p is locally attracting when |g^'(p)|<1 and repelling when |g^'(p)|>1. When 0<|g^'(p)|<1, convergence is generally linear with asymptotic error ratio |g^'(p)|. The problem of finding a root of f(x)=0 can be converted to fixed point form x=g(x), but different choices of g can have different convergence behavior (Schröder 1870). Newton's method, for example, is the fixed point iteration with g(x)=x-f(x)/f^'(x).

Fixed point iteration can be computed in the Wolfram Language using FixedPoint[g, x0]. The intermediate iterates are returned by FixedPointList[g, x0]. For example, iterating g(x)=cosx from x_0=1 converges to the Dottie number.


See also

Banach Fixed Point Theorem, Fixed Point, Iteration, Mann Iteration, Newton's Method, Picard Iteration

Explore with Wolfram|Alpha

References

Banach, S. "Sur les opérations dans les ensembles abstraits et leur application aux équations intégrales." Fund. Math. 3, 133-181, 1922. https://doi.org/10.4064/fm-3-1-133-181.Berinde, V. Iterative Approximation of Fixed Points, 2nd ed. Berlin, Germany: Springer-Verlag, 2007.Schröder, E. "Ueber unendlich viele Algorithmen zur Auflösung der Gleichungen." Math. Ann. 2, 317-365, 1870. https://doi.org/10.1007/BF01444024.

Cite this as:

Weisstein, Eric W. "Fixed Point Iteration." From MathWorld--A Wolfram Resource. https://mathworld.wolfram.com/FixedPointIteration.html

Subject classifications