Content
Summary
Orthogonal polynomials form a basis for function spaces where distinct polynomials have zero inner product, enabling efficient least squares approximation without solving normal equations. They are constructed via Gram-Schmidt orthogonalization and satisfy a three-term recurrence relation, with classical examples like Legendre and Chebyshev polynomials defined by specific weight functions. Their zeros provide optimal nodes for Gaussian quadrature, ensuring exact integration for polynomials up to degree .
Intuition
Think of orthogonal polynomials as a specialized coordinate system for functions, similar to how orthogonal vectors simplify geometry in linear algebra. In this system, each polynomial is 'perpendicular' to all lower-degree polynomials, meaning they capture independent aspects of a function's shape. This independence allows us to approximate complex functions by simply projecting them onto these basis elements, avoiding the computational complexity of coupled equations. The structure is rigidly defined by a weight function that dictates the 'geometry' of the space, ensuring that the polynomials remain orthogonal across the chosen interval.
Key equations
Definition of orthogonality for distinct polynomials in the sequence.
Best least squares approximation of function f using orthogonal basis.
Three-term recurrence relation for generating orthogonal polynomials.
Gaussian quadrature formula using zeros of as nodes.
Derivation
- Start with the monomial basis in the space of polynomials.
- Apply Gram-Schmidt orthogonalization to generate orthogonal to all .
- Since has degree and is orthogonal to the subspace , it satisfies a three-term recurrence relation derived from expanding in the orthogonal basis.
- The coefficients of this recurrence depend on the leading coefficients and norms of the polynomials.
- For least squares approximation, the orthogonality property ensures that the projection coefficients are independent, simplifying the solution to a sum of projections.
- The zeros of are real, distinct, and lie in , allowing Gaussian quadrature to achieve exactness for polynomials of degree up to .
Worked example
Calculate the first two Legendre polynomials and on with weight , given the recurrence and normalization .
- For , the recurrence is not directly applicable for generation, but we define based on normalization. Since and degree is 0, .
- For , use the recurrence with : .
- Simplify: .
- Check normalization: , which satisfies the condition.
Answer P_0(x) = 1, P_1(x) = x
Common mistakes
- Confusing orthogonality with orthonormality; orthogonality requires zero inner product for distinct polynomials, but orthonormality also requires unit norm.
- Assuming the leading coefficient is fixed; it can be chosen arbitrarily (e.g., ) without affecting orthogonality, but it changes the normalization.
- Believing Gaussian quadrature is exact for all polynomials; it is exact only for polynomials of degree less than when using nodes.
- Ignoring the weight function ; the orthogonality and recurrence relations depend critically on the specific weight function and interval.