Threads
DFALG 1Complex numbers
For z=0, the polar form of z is
z=r(cosθ+isinθ)=reiθ,r=∣z∣>0,where θ is an argument of z. The expressions a+bi and reiθ are two writings of the same complex number.
- 3Roots, modes and evolution / a root as a scaling and a rotation
THALG 1Complex numbers
Write a characteristic root in polar form as
rj=ρjeiθj.Then
∣rjn∣=ρjn.Thus ρj<1 gives a decaying mode, ρj>1 gives an unbounded mode and ρj=1 gives a non-decaying mode.
- 3Roots, modes and evolution / discrete time: ∣r∣ decides
THALG 1Complex numbers
For a characteristic root r=α+iβ,
∣ert∣=eαt.Therefore α<0 gives decay, α>0 gives an unbounded mode and, for a simple root, α=0 gives a non-decaying oscillatory or constant mode. A repeated root on the imaginary axis introduces a term tert, whose magnitude is unbounded.
- 3Roots, modes and evolution / continuous time: Rer decides
MTCAL 1Integration techniques
For a>0, choose the indicated trigonometric or hyperbolic branch so that the substitution is one-to-one on the interval being integrated. Keep the absolute value when simplifying a square root until the chosen range fixes its sign; for example, a2−a2sin2θ=a∣cosθ∣.
| Integrand factor | Substitutions | Identities |
|---|---|---|
| a2−x2 | x=asinθ, dx=acosθdθ or x=atanhθ, dx=asech2θdθ | cos2θ+sin2θ=1, sech2θ+tanh2θ=1 |
| a2+x2 | x=atanθ, dx=asec2θdθ or x=asinhθ, dx=acoshθdθ | sec2θ=tan2θ+1, cosh2θ=1+sinh2θ |
| x2−a2 | x=asecθ, dx=asecθtanθdθ or, for x≥a, x=acoshθ, dx=asinhθdθ | sec2θ=1+tan2θ, cosh2θ=1+sinh2θ |
- 5Accumulation and changes of variables / single integrals
THALG 2Vector spaces
If B={u1,…,un} is a basis for V, then every vector v∈V has a unique representation
v=λ1u1+⋯+λnun,λ1,…,λn∈F.- 1Coordinates and linear structure / why coordinates are unique
DFALG 2Vector spaces
Let B=(u1,…,un) be an ordered basis for a vector space V. If
u=x1u1+⋯+xnun,then the coordinate vector of u with respect to B is the column
[u]B=x1⋮xn.- 1Coordinates and linear structure / coordinates in a basis
DFALG 2Vector spaces
Given n distinct inputs t1,…,tn and prescribed outputs y1,…,yn, polynomial interpolation finds the polynomial f∈Pn−1 satisfying
f(ti)=yi,i=1,…,n.Using the standard basis
B=(1,t,t2,…,tn−1),write
f(t)=a0+a1t+⋯+an−1tn−1.The coefficients form the coordinate vector
[f]B=a0a1⋮an−1.- 1Coordinates and linear structure / coordinates of a polynomial
- 4Local approximation / match values instead of derivatives
MTCAL 2Ordinary differential equations
For an equation of the form
dxdy=f(xy),set y=xv(x). Then
y′=v+xv′,so
xv′=f(v)−v,dxdv=xf(v)−v.The resulting equation is separable on an interval where x=0 and the required denominators are nonzero.
- 5Accumulation and changes of variables / ODEs: a substitution makes it separable
MTCAL 2Ordinary differential equations
Solve the characteristic equation and choose the real homogeneous modes according to the roots:
- If r1=r2 are distinct real roots, use yh=Aer1x+Ber2x.
- If r is a repeated real root, use yh=(A+Bx)erx.
- If the roots are r=α±iβ with β=0, use yh=eαx(Acos(βx)+Bsin(βx)).
- 3Roots, modes and evolution / scalar ODEs
THCAL 2Ordinary differential equations
Write a linear equation as
L[y]=f(x),L[y]=ay′′+by′+cy.If yp is one particular solution and yh is any homogeneous solution, then the complete solution is
y=yh+yp.- 2Kernels and solution sets / constant-coefficient ODEs
MTCAL 2Ordinary differential equations
For suitable forcing functions:
- a polynomial of degree n suggests a general polynomial of degree n;
- eβx suggests Ceβx;
- pn(x)eβx suggests qn(x)eβx, where qn has degree n;
- sin(βx) or cos(βx) suggests C1cos(βx)+C2sin(βx);
- eαxsin(βx) or eαxcos(βx) suggests eαx(C1cos(βx)+C2sin(βx)).
Substitute the trial into the equation and match coefficients. If the trial overlaps with a homogeneous mode whose characteristic root has multiplicity s, multiply the whole trial by xs (so a simple overlap requires one factor of x, while a repeated root requires x2).
- 2Kernels and solution sets / finding a particular solution
DFCAL 2Ordinary differential equations
The kernel of a linear differential operator T is
ker(T)={y:T[y]=0}.- 2Kernels and solution sets / the kernel of a differential operator
THCAL 2Ordinary differential equations
If T[y]=f and yp is one particular solution, then
{all solutions of T[y]=f}=yp+ker(T).Equivalently, every solution is yp+yh for some homogeneous solution yh.
- 2Kernels and solution sets / linear differential equations
DFALG 3Linear transformations
If T:V→W is a linear map, its kernel is
ker(T)={u∈V:T(u)=0}.The same set is also called the null space. If A∈Fm×n is regarded as the map Fn→Fm, then
ker(A)={x∈Fn:Ax=0}.- 2Kernels and solution sets / the kernel
THALG 3Linear transformations
Let A be a matrix over an infinite scalar field F (such as R or C), let b be a vector of the appropriate dimension and let [A∣b] be the augmented matrix formed by appending b to A. The equation Ax=b has:
- no solution if rank(A)=rank([A∣b]);
- a unique solution if rank(A)=rank([A∣b])andnullity(A)=0;
- infinitely many solutions if rank(A)=rank([A∣b])andnullity(A)>0.
In the last case, if nullity(A)=k, then every solution has the form
x=xp+ω1u1+⋯+ωkuk,where xp is any particular solution of Ax=b, {u1,…,uk} is a basis for ker(A) and ω1,…,ωk∈F.
- 2Kernels and solution sets / matrix equations
THALG 3Linear transformations
Let T:V→W be a linear map, where dim(V)=n and dim(W)=m. For ordered bases
BV=(v1,…,vn),BW=(w1,…,wm),form the coordinate columns
aj=[T(vj)]BW(j=1,…,n).Then
A=(a1⋯an)is the unique m×n matrix satisfying
[T(v)]BW=A[v]BVfor every v∈V.We call A the matrix representation of T relative to BV and BW and may write it as [T]BVBW.
With this notation, the subscript names the domain basis and the superscript names the codomain basis, matching the direction [v]BV↦[T(v)]BW in the displayed coordinate identity.
- 1Coordinates and linear structure / a linear map in coordinates
DFCAL 3Taylor series, sequences and infinite series
If f has derivatives through order n at a, its Taylor polynomial of degree at most n about a is
Pn(x)=k=0∑nk!f(k)(a)(x−a)k.- 4Local approximation / one variable: match derivatives at a centre
THCAL 3Taylor series, sequences and infinite series
Suppose f has n+1 continuous derivatives on an interval containing a and x. If
Pn(x)=k=0∑nk!f(k)(a)(x−a)k,then
f(x)=Pn(x)+Rn+1(x),where the integral remainder is
Rn+1(x)=n!1∫axf(n+1)(t)(x−t)ndt.For x=a, there is also a point c between a and x for which the Lagrange remainder is
Rn+1(x)=(n+1)!f(n+1)(c)(x−a)n+1.- 4Local approximation / the error term
THCAL 3Taylor series, sequences and infinite series
Suppose k is an integer with k≥2 and f has k+1 continuous derivatives on a neighbourhood of a. If
f(j)(a)=0(1≤j<k),f(k)(a)=0.then Taylor's theorem gives
f(x)−f(a)=k!f(k)(a)(x−a)k+Rk+1(x),Rk+1(x)=O(∣x−a∣k+1),Rk+1(x)=o(∣x−a∣k).Thus, locally:
- if k is even and f(k)(a)>0, a is a local minimum;
- if k is even and f(k)(a)<0, a is a local maximum;
- if k is odd, the leading term changes sign across a, giving a horizontal point of inflection.
- 4Local approximation / classifying stationary points in one variable
DFALG 4Eigenvalues
An n×n matrix A over a field F is diagonalisable over F if there are an invertible matrix P∈Mn(F) and a diagonal matrix D∈Mn(F) such that
P−1AP=D,equivalentlyA=PDP−1.The columns of P are the eigenvectors in the chosen eigenbasis and the corresponding eigenvalues appear on the diagonal of D.
- 5Accumulation and changes of variables / linear maps: a basis that decouples
THALG 4Eigenvalues
An n×n matrix over F is diagonalisable over F if and only if it has n linearly independent eigenvectors in Fn.
- 1Coordinates and linear structure / a basis where the matrix is diagonal
THALG 4Eigenvalues
Suppose A=PDP−1 is diagonalisable, so it has an eigenbasis. A mode contribution cλkv with c=0 decays to zero when ∣λ∣<1, has constant magnitude when ∣λ∣=1 and grows when ∣λ∣>1. Without an eigenbasis, a Jordan block can produce additional factors such as kλk−1, so the diagonalisation hypothesis is what makes this scalar classification complete (especially at the unit circle).
- 3Roots, modes and evolution / matrix powers
THALG 4Eigenvalues
For a constant matrix A and a non-zero vector u, the function
x(t)=ueλtis a solution of x′=Ax if and only if λ is an eigenvalue of A and u is a corresponding eigenvector. The zero solution is handled separately by taking u=0.
- 3Roots, modes and evolution / coupled ODEs: eigenvectors as modes
THALG 4Eigenvalues
Suppose that a transition matrix A satisfies:
- 1 is an eigenvalue with algebraic multiplicity 1;
- every other eigenvalue λj has ∣λj∣<1;
- there is a basis of eigenvectors for Rn.
Then x(k+1)=Ax(k) has a limit p in the eigenspace for λ=1. It is the unique vector in that eigenspace whose component sum equals the component sum of x(0); it may be zero when that sum is zero. If x(0) is a probability vector, then p is the stationary distribution and does not depend on the initial probabilities.
- 3Roots, modes and evolution / Markov systems
THCAL 4Functions of several variables
If f is differentiable at a=(x0,y0) and z0=f(x0,y0), then the tangent plane to z=f(x,y) at (x0,y0,z0) is
z=f(x0,y0)+fx(x0,y0)(x−x0)+fy(x0,y0)(y−y0).- 4Local approximation / first-order model in several variables
DFCAL 4Functions of several variables
Let a=(x0,y0), hx=x−x0 and hy=y−y0. If f has continuous partial derivatives through order three near a, its Taylor polynomial through total degree three is
T3(x,y)=f(a)+fx(a)hx+fy(a)hy+2!1(fxx(a)hx2+2fxy(a)hxhy+fyy(a)hy2)+3!1(fxxx(a)hx3+3fxxy(a)hx2hy+3fxyy(a)hxhy2+fyyy(a)hy3).The degree-two part can be written with the Hessian as
T2(x)=f(a)+∇f(a)⋅(x−a)+21(x−a)THf(a)(x−a).- 4Local approximation / second-order model: the Hessian
THCAL 4Functions of several variables
Let x0=(x0,y0) be a stationary point. Assume that f has continuous second-order partial derivatives on a neighbourhood of x0 (so f is C2 there). Define
D=detHf(x0)=fxx(x0)fyy(x0)−fxy(x0)2.Then:
- if D>0 and fxx(x0)>0, x0 is a local minimum;
- if D>0 and fxx(x0)<0, x0 is a local maximum;
- if D<0, x0 is a saddle point;
- if D=0, the test is inconclusive.
- 4Local approximation / classifying stationary points in several variables
THCAL 5Double integrals
Let Ω be a region in (x,y)-coordinates and let Φ be a region in (u,v)-coordinates. Assume that f is integrable on Ω, that g is C1 on Φ, that Φ can be split into finitely many pieces on which g is one-to-one with non-overlapping interiors and that the Jacobian is nonzero away from boundary or other exceptional sets of area zero. The images of those pieces must cover Ω once, apart from boundaries of area zero; otherwise the transformed integral can omit or count part of the region more than once. If a map covers the target with multiplicity, split the parameter region into one-to-one pieces (or account for that multiplicity) before applying the formula. Then
∬Ωf(x,y)dxdy=∬Φf(x(u,v),y(u,v))∣detJg(u,v)∣dudv.- 5Accumulation and changes of variables / double integrals: the Jacobian scales area
THCAL 5Double integrals
For r≥0, the polar-coordinate change of variables is
x=rcosθ,y=rsinθ,and its Jacobian satisfies
∂(r,θ)∂(x,y)=r.Consequently,
dA=rdrdθ,and
∬Ωf(x,y)dA=∬Φf(rcosθ,rsinθ)rdrdθ.- 5Accumulation and changes of variables / polar coordinates
1 / Algebra / 5 stops
A basis turns vectors and maps into columns and matrices; a good basis makes the calculation simple.
2 / Algebra / Calculus / 6 stops
Every solution of T(x)=b is one particular solution plus an element of kerT.
3 / Algebra / Calculus / 7 stops
A linear evolution splits into modes rn or ert, and the roots r decide growth, decay and oscillation.
4 / Algebra / Calculus / 7 stops
Replace a hard object by a simple model that matches it near a point, and bound the error.
5 / Algebra / Calculus / 5 stops
A change of variables redescribes the problem so the calculation is simpler, paying a scale factor such as a Jacobian.
- Within a chapter
- Waiting between chapters
- A stop
- One stop on two threads
- Pinned
- The thread in question