Trigonometry/For Enthusiasts/Chebyshev Polynomials

From testwiki
Jump to navigation Jump to search

Template:Warning


The Chebyshev polynomials, named after Pafnuty Chebyshev,[1] are a sequence of polynomials related to the trigonometric multi-angle formulae.

We usually distinguish between

  • Chebyshev polynomials of the first kind, denoted Tn and are closely related to cos and
  • Chebyshev polynomials of the second kind, denoted Un which are closely related to sin

The letter T is used because of the alternative transliterations of the name Chebyshev as Tchebycheff (French) or Tschebyschow (German).

The Chebyshev polynomials Tn or Un are polynomials of degree n and the sequence of Chebyshev polynomials of either kind composes a 'polynomial sequence'.

Examples

The first few Chebyshev polynomials of the first kind in the domain Template:Nowrap: The flat T0, T1, T2, T3, T4 and T5.

The first few Chebyshev polynomials of the first kind are

T0(x)=1
T1(x)=x
T2(x)=2x21
T3(x)=4x33x
T4(x)=8x48x2+1
T5(x)=16x520x3+5x
T6(x)=32x648x4+18x21
T7(x)=64x7112x5+56x37x
T8(x)=128x8256x6+160x432x2+1
T9(x)=256x9576x7+432x5120x3+9x
The first few Chebyshev polynomials of the second kind in the domain −1 < x < 1: The flat U0, U1, U2, U3, U4 and U5. Although not visible in the image, Template:Nowrap and Template:Nowrap.

The first few Chebyshev polynomials of the second kind are

U0(x)=1
U1(x)=2x
U2(x)=4x21
U3(x)=8x34x
U4(x)=16x412x2+1
U5(x)=32x532x3+6x
U6(x)=64x680x4+24x21
U7(x)=128x7192x5+80x38x
U8(x)=256x8448x6+240x440x2+1
U9(x)=512x91024x7+672x5160x3+10x

Definition of Tn(x)

There are many alternative ways to define Tn(x) which lead to the same polynomials. The definition we'll use for Tn(x) is:

Tn(x)=cos(narccos(x)),x[1,1]

In other words, Tn(x) is the polynomial that expresses cos(nθ) in terms of cos(θ) .

For example:

T3(x)=4x33x

comes directly from:

cos(3θ)=4cos3(θ)3cos(θ)


Using this definition the recurrence relationship for Chebyshev polynomials follows immediately:

T0(x)=1T1(x)=xTn+1(x)=2xTn(x)Tn1(x)


The recurrence comes from the relation:

cos((n+1)θ)=2cos(θ)cos(nθ)cos((n1)θ)

Which is a rearrangement of a relation derived from the addition formula for cosines:

cos(nθ+θ)+cos(nθθ)=2cos(nθ)cos(θ)

a special case where ϕ=nθ of

cos(ϕ+θ)+cos(ϕθ)=2cos(ϕ)cos(θ)

That we saw with beat frequencies when adding two waves together.

Uses

If approximating some function on the interval (0,1) one can use a polynomial approximation like:

0.7123+1.543x+0.311x2+0.0172x3

to approximate its values. Because x is between 0 and 1 the xn terms get smaller from left to right. With a sufficiently large number of terms, usually more than we have here, we can typically get very good approximations to well behaved functions. In the example we've truncated the series at the fourth term and are ignoring terms of x4 and higher.

In the example polynomial above the actual numbers are just made up numbers, as an example, and have no special significance - in case you are wondering why those particular numbers were used.

It turns out that truncating a series is in a certain sense not the best possible way to approximate the original function's actual values with a polynomial of degree three. A more complex but better way uses Chebyshev polynomials.


If instead we can express the function as:

a0+a1T1(x)+a2T2(x)+a3T3(x)+

where a0,a1,a2,a3 are constants then if we truncate this series at the fourth term, i.e T3, we again have a polynomial with no terms x4 or higher. After we've expanded it out and collected the coefficients together, the coefficients will not generally be the same as when just truncating the series. It may sound crazy, so a worked example can show this more clearly.

Template:ExampleRobox

12x=12+x4+x28+x316+...

A quick check... does this formula look reasonable?

Put x=0 and we get 1/2.

Put x=1 and we get

12+14+18+116+=1.

The formula looks reasonable.

If we go to just four terms the error at x=1 is 116.

Now expressing this in Chebyshev polynomials:

11x=12+T1(x)4+T2(x)16+T3(x)64+...

Expanding this out we get:

0.53125+0.203125x+0.125x2+0.0625x3

to-do: add graph showing worst error is better. Unfortunately it isn't with the current calculation.

Hmm... still looks like I need to recompute the Chebyshev coefficients.


Template:Robox/Close


Chebyshev polynomials are important in approximation theory because the roots of the Chebyshev polynomials Tn, are used as nodes in polynomial interpolation. The resulting interpolation polynomial minimizes the problem of Runge's phenomenon and provides an approximation that is close to the polynomial of best approximation to a continuous function under the maximum norm.



Template:Warning

Explicit formulae

Different approaches to defining Chebyshev polynomials lead to different explicit formulae such as:

Tn(x)={cos(narccos(x)) x[1,1]cosh(narccosh(x)) x1(1)ncosh(narccosh(x)) x1


Tn(x)=(xx21)n+(x+x21)n2=k=0n2(n2k)(x21)kxn2k=xnk=0n2(n2k)(1x2)k=n2k=0n2(1)k(nk1)!k!(n2k)!(2x)n2k(n>0)=nk=0n(2)k(n+k1)!(nk)!(2k)!(1x)k(n>0)=2F1(n,n,12,1x2)


Un(x)=(x+x21)n+1(xx21)n+12x21=k=0n2(n+12k+1)(x21)kxn2k=xnk=0n2(n+12k+1)(1x2)k=k=0n2(2k(n+1)k)(2x)n2k(n>0)=k=0n2(1)k(nkk)(2x)n2k(n>0)=k=0n(2)k(n+k+1)!(nk)!(2k+1)!(1x)k(n>0)=(n+1)2F1(n,n+2,32,1x2)

where 2F1 is a hypergeometric function.

Uses

Chebyshev polynomials are important in approximation theory because the roots of the Chebyshev polynomials Tn, are used as nodes in polynomial interpolation. The resulting interpolation polynomial minimizes the problem of Runge's phenomenon and provides an approximation that is close to the polynomial of best approximation to a continuous function under the maximum norm.

In the study of Differential equations they arise as the solution to the Chebyshev differential equations

(1x2)yxy+n2y=0

and

(1x2)y3xy+n(n+2)y=0

for the polynomials of the first and second kind, respectively. These equations are special cases of the Sturm–Liouville differential equation.

Definition

The Chebyshev polynomials of the first kind are defined by the recurrence relation

T0(x)=1T1(x)=xTn+1(x)=2xTn(x)Tn1(x).

The conventional generating function for Tn is

n=0Tn(x)tn=1tx12tx+t2.

The exponential generating function is

n=0Tn(x)tnn!=12(e(xx21)t+e(x+x21)t).

The Chebyshev polynomials of the second kind are defined by the recurrence relation

U0(x)=1U1(x)=2xUn+1(x)=2xUn(x)Un1(x).

One example of a generating function for Un is

n=0Un(x)tn=112tx+t2.

Trigonometric definition

The Chebyshev polynomials of the first kind can be defined by the trigonometric identity:

Tn(x)=cos(narccosx)=cosh(narccoshx)

whence:

Tn(cos(ϑ))=cos(nϑ)

for n = 0, 1, 2, 3, ..., while the polynomials of the second kind satisfy:

Un(cos(ϑ))=sin((n+1)ϑ)sinϑ

which is structurally quite similar to the Dirichlet kernel Dn(x):

Dn(x)=sin((2n+1)(x/2))sin(x/2)=U2n(cos(x/2))

That cos(nx) is an nth-degree polynomial in cos(x) can be seen by observing that cos(nx) is the real part of one side of de Moivre's formula, and the real part of the other side is a polynomial in cos(x) and sin(x), in which all powers of sin(x) are even and thus replaceable via the identity cos2(x) + sin2(x) = 1.

This identity is extremely useful in conjunction with the recursive generating formula inasmuch as it enables one to calculate the cosine of any integral multiple of an angle solely in terms of the cosine of the base angle. Evaluating the first two Chebyshev polynomials:

T0(x)=cos 0x =1

and:

T1(cos(x))=cos(x)

one can straightforwardly determine that:

cos(2ϑ)=2cosϑcosϑcos(0ϑ)=2cos2ϑ1
cos(3ϑ)=2cosϑcos(2ϑ)cosϑ=4cos3ϑ3cosϑ

and so forth. To trivially check whether the results seem reasonable, sum the coefficients on both sides of the equals sign (that is, setting ϑ equal to zero, for which the cosine is unity), and one sees that 1 = Template:Nowrap in the former expression and 1 = Template:Nowrap in the latter.

Two immediate corollaries are the composition identity (or the "nesting property")

Tn(Tm(x))=Tnm(x).

and the expression of complex exponentiation in terms of Chebyshev polynomials: given z = a + bi,

zn=|z|n(cos(narccosa|z|)+isin(narccosa|z|))=|z|nTn(a|z|)+ib |z|n1 Un1(a|z|).

Pell equation definition

The Chebyshev polynomials can also be defined as the solutions to the Pell equation

Tn(x)2(x21)Un1(x)2=1

in a ring R[x].[2] Thus, they can be generated by the standard technique for Pell equations of taking powers of a fundamental solution:

Tn(x)+Un1(x)x21=(x+x21)n.

Relation between Chebyshev polynomials of the first and second kinds

The Chebyshev polynomials of the first and second kind are closely related by the following equations

ddxTn(x)=nUn1(x) , n=1,
Tn(x)=12(Un(x)Un2(x)).
Tn+1(x)=xTn(x)(1x2)Un1(x)
Tn(x)=Un(x)xUn1(x).

The recurrence relationship of the derivative of Chebyshev polynomials can be derived from these relations

2Tn(x)=1n+1ddxTn+1(x)1n1ddxTn1(x) , n=1,

This relationship is used in the Chebyshev spectral method of solving differential equations.

Equivalently, the two sequences can also be defined from a pair of mutual recurrence equations:

T0(x)=1
U1(x)=0
Tn+1(x)=xTn(x)(1x2)Un1(x)
Un(x)=xUn1(x)+Tn(x)

These can be derived from the trigonometric formulae; for example, if x=cosϑ, then

Tn+1(x)=Tn+1(cos(ϑ))=cos((n+1)ϑ)=cos(nϑ)cos(ϑ)sin(nϑ)sin(ϑ)=Tn(cos(ϑ))cos(ϑ)Un1(cos(ϑ))sin2(ϑ)=xTn(x)(1x2)Un1(x).

Note that both these equations and the trigonometric equations take a simpler form if we, like some works, follow the alternate convention of denoting our Un (the polynomial of degree n) with Un+1 instead.


Properties

Roots and extrema

A Chebyshev polynomial of either kind with degree n has n different simple roots, called Chebyshev roots, in the interval [−1,1]. The roots are sometimes called Chebyshev nodes because they are used as nodes in polynomial interpolation. Using the trigonometric definition and the fact that

cos(π2(2k+1))=0

one can easily prove that the roots of Tn are

xk=cos(π22k1n),k=1,,n.

Similarly, the roots of Un are

xk=cos(kn+1π),k=1,,n.

One unique property of the Chebyshev polynomials of the first kind is that on the interval Template:Nowrap all of the extrema have values that are either −1 or 1. Thus these polynomials have only two finite critical values, the defining property of Shabat polynomials. Both the first and second kinds of Chebyshev polynomial have extrema at the endpoints, given by:

Tn(1)=1
Tn(1)=(1)n
Un(1)=n+1
Un(1)=(n+1)(1)n.

Differentiation and integration

The derivatives of the polynomials can be less than straightforward. By differentiating the polynomials in their trigonometric forms, it's easy to show that:

dTndx=nUn1
dUndx=(n+1)Tn+1xUnx21
d2Tndx2=nnTnxUn1x21=n(n+1)TnUnx21.

The last two formulas can be numerically troublesome due to the division by zero (0/0 indeterminate form, specifically) at Template:Nowrap and Template:Nowrap. It can be shown that:

d2Tndx2|x=1=n4n23,
d2Tndx2|x=1=(1)nn4n23.

Template:Hidden begin The second derivative of the Chebyshev polynomial of the first kind is

T'n=nnTnxUn1x21

which, if evaluated as shown above, poses a problem because it is indeterminate at x = ±1. Since the function is a polynomial, (all of) the derivatives must exist for all real numbers, so the taking to limit on the expression above should yield the desired value:

T'n(1)=limx1nnTnxUn1x21

where only x=1 is considered for now. Factoring the denominator:

T'n(1)=limx1nnTnxUn1(x+1)(x1)=limx1nnTnxUn1x1x+1.

Since the limit as a whole must exist, the limit of the numerator and denominator must independently exist, and

T'n(1)=nlimx1nTnxUn1x1limx1(x+1)=n2limx1nTnxUn1x1.

The denominator (still) limits to zero, which implies that the numerator must be limiting to zero, i.e. Un1(1)=nTn(1)=n which will be useful later on. Since the numerator and denominator are both limiting to zero, L'Hôpital's rule applies:

T'n(1)=n2limx1ddx(nTnxUn1)ddx(x1)=n2limx1ddx(nTnxUn1)=n2limx1(n2Un1Un1xddx(Un1))=n2(n2Un1(1)Un1(1)limx1xddx(Un1))=n42n2212limx1ddx(nUn1)=n42n22T'n(1)2T'n(1)=n4n23.

The proof for x=1 is similar, with the fact that Tn(1)=(1)n being important. Template:Hidden end

Indeed, the following, more general formula holds:

dpTndxp|x=±1=(±1)n+pk=0p1n2k22k+1.

This latter result is of great use in the numerical solution of eigenvalue problems.

Concerning integration, the first derivative of the Tn implies that

Undx=Tn+1n+1

and the recurrence relation for the first kind polynomials involving derivatives establishes that

Tndx=12(Tn+1n+1Tn1n1)=nTn+1n21xTnn1.

Orthogonality

Both the TN(x) and the UN(x) form a sequence of orthogonal polynomials. The polynomials of the first kind are orthogonal with respect to the weight

11x2

on the interval (1,1) , i.e. we have:

11Tn(x)Tm(x)dx1x2={0:nmπ:n=m=0π2:n=m0

This can be proven by letting x=cos(ϑ) and using the identity Tn(cos(ϑ))=cos(nϑ) .

Similarly, the polynomials of the second kind are orthogonal with respect to the weight

1x2

on the interval [1,1] , i.e. we have:

11Un(x)Um(x)1x2dx={0:nmπ2:n=m

(Note that the weight 1x2 is, to within a normalizing constant, the density of the Wigner semicircle distribution).

The Tn also satisfy a discrete orthogonality condition:

k=0N1Ti(xk)Tj(xk)={0:ijN:i=j=0N2:i=j0

where the xk are the N GaussLobatto zeros of TN(x)

xk=cos(π(k+12)N)

Minimal ∞-norm

For any given n ≥ 1, among the polynomials of degree n with leading coefficient 1,

f(x)=12n1Tn(x)

is the one of which the maximal absolute value on the interval [−1, 1] is minimal.

This maximal absolute value is

12n1

and|ƒ(x)| reaches this maximum exactly Template:Nowrap times: at

x=coskπn for 0kn.

Proof

Let's assume that wn(x) is a polynomial of degree n with leading coefficient 1 with maximal absolute value on the interval [−1, 1] less than 12n1.

We define

fn(x)=12n1Tn(x)wn(x)

Because at extreme points of Tn we have |wn(x)|<|12n1Tn(x)|

fn(x)>0 for x=cos2kπn where 02kn
fn(x)<0 for x=cos(2k+1)πn where 02k+1n

fn(x) is a polynomial of degree Template:Nowrap, so from the intermediate value theorem it has at least n roots which is impossible for polynomial of degree Template:Nowrap.

Other properties

The Chebyshev polynomials are a special case of the ultraspherical or Gegenbauer polynomials, which themselves are a special case of the Jacobi polynomials:

  • Tn(x)=1(n12n)Pn12,12(x)=n2Cn0(x),
  • Un(x)=12(n+12n)Pn12,12(x)=Cn1(x).

For every nonnegative integer n, Tn(x) and Un(x) are both polynomials of degree n. They are even or odd functions of x as n is even or odd, so when written as polynomials of x, it only has even or odd degree terms respectively. In fact,

Tn(12x2)=(1)nT2n(x)

and

Un(12x2)x=(1)nU2n+1(x).

The leading coefficient of Tn is Template:Nowrap if Template:Nowrap, but 1 if Template:Nowrap.

Tn are a special case of Lissajous curves with frequency ratio equal to n.

Several polynomial sequences like Lucas polynomials (Ln), Dickson polynomials(Dn), Fibonacci polynomials(Fn) are related to Chebyshev polynomials Tn and Un.

The Chebyshev polynomials of the first kind satisfy the relation

Tj(x)Tk(x)=12(Tj+k(x)+T|jk|(x)),j,k0,

which is easily proved from the product-to-sum formula for the cosine. The polynomials of the second kind satisfy the similar relation

Tj(x)Uk(x)=12(Uj+k(x)+Ukj(x)),j,k.

Similar to the formula

Tn(cosθ)=cos(nθ)

we have the analogous formula

T2n+1(sinθ)=(1)nsin((2n+1)θ).


As a basis set

The non-smooth function (top) Template:Nowrap, where H is the Heaviside step function, and (bottom) the 5th partial sum of its Chebyshev expansion. The 7th sum is indistinguishable from the original function at the resolution of the graph.

In the appropriate Sobolev space, the set of Chebyshev polynomials form a complete basis set, so that a function in the same space can, on Template:Nowrap be expressed via the expansion:[3]

f(x)=n=0anTn(x).

Furthermore, as mentioned previously, the Chebyshev polynomials form an orthogonal basis which (among other things) implies that the coefficients an can be determined easily through the application of an inner product. This sum is called a Chebyshev series or a Chebyshev expansion.

Since a Chebyshev series is related to a Fourier cosine series through a change of variables, all of the theorems, identities, etc. that apply to Fourier series have a Chebyshev counterpart.[3] These attributes include:

  • The Chebyshev polynomials form a complete orthogonal system.
  • The Chebyshev series converges to ƒ(x) if the function is piecewise smooth and continuous. The smoothness requirement can be relaxed in most cases — as long as there are a finite number of discontinuities in ƒ(x) and its derivatives.
  • At a discontinuity, the series will converge to the average of the right and left limits.

The abundance of the theorems and identities inherited from Fourier series make the Chebyshev polynomials important tools in numeric analysis; for example they are the most popular general purpose basis functions used in the spectral method,[3] often in favor of trigonometric series due to generally faster convergence for continuous functions (Gibbs' phenomenon is still a problem).

Example 1

Consider the Chebyshev expansion of log(1+x) . One can express

log(1+x)=n=0anTn(x)

One can find the coefficients an either through the application of an inner product or by the discrete orthogonality condition. For the inner product,

11Tm(x)log(1+x)1x2dx=n=0an11Tm(x)Tn(x)1x2dx

which gives

an={log(2):n=02(1)nn:n>0

Alternatively, when you cannot evaluate the inner product of the function you are trying to approximate, the discrete orthogonality condition gives

an=2δ0nNk=0N1Tn(xk)log(1+xk)

where δij is the Kronecker delta function and the xk are the N Gauss–Lobatto zeros of TN(x)

xk=cos(π(k+12)N)

This allows us to compute the coefficients an very efficiently through the discrete cosine transform

an=2δ0nNk=0N1cos(nπ(k+12)N)log(1+xk)

Example 2

To provide another example:

(1x2)α=1πΓ(12+α)Γ(α+1)+212αn=0(1)n(2ααn)T2n(x)=22αn=0(1)n(2α+1αn)U2n(x).


Partial sums

The partial sums of

f(x)=n=0anTn(x)

are very useful in the approximation of various functions and in the solution of differential equations (see spectral method). Two common methods for determining the coefficients an are through the use of the inner product as in Galerkin's method and through the use of collocation which is related to interpolation.

As an interpolant, the N coefficients of the Template:Nowrap partial sum are usually obtained on the Chebyshev–Gauss–Lobatto[4] points (or Lobatto grid), which results in minimum error and avoids Runge's phenomenon associated with a uniform grid. This collection of points corresponds to the extrema of the highest order polynomial in the sum, plus the endpoints and is given by:

xi=cos(iπN1); i=0,1,,N1.

Polynomial in Chebyshev form

An arbitrary polynomial of degree N can be written in terms of the Chebyshev polynomials of the first kind. Such a polynomial p(x) is of the form

p(x)=n=0NanTn(x).

Polynomials in Chebyshev form can be evaluated using the Clenshaw algorithm.

Spread polynomials

The spread polynomials are in a sense equivalent to the Chebyshev polynomials of the first kind, but enable one to avoid square roots and conventional trigonometric functions in certain contexts, notably in rational trigonometry.


Notes

  1. Chebyshev polynomials were first presented in: P. L. Chebyshev (1854) "Théorie des mécanismes connus sous le nom de parallélogrammes," Mémoires des Savants étrangers présentés à l’Académie de Saint-Pétersbourg, vol. 7, pages 539-586.
  2. Jeroen Demeyer Diophantine Sets over Polynomial Rings and Hilbert's Tenth Problem for Function Fields, Ph.D. theses (2007), p.70.
  3. 3.0 3.1 3.2 Template:Cite book
  4. Chebyshev Interpolation: An Interactive Tour

Credits



Template:BookCat