Ordinary Differential Equation
y ′ = F ( x , y ) y'=F(x,y) y ′ = F ( x , y ) , F ( x , y ) = 0 F(x, y)=0 F ( x , y ) = 0 are equilibrium solutions.
Separable ODE
d y d x = F ( x , y ) = P ( x ) Q ( y ) \frac{dy}{dx} = F(x, y) = \frac{P(x)}{Q(y)} d x d y = F ( x , y ) = Q ( y ) P ( x )
∫ Q ( y ) d y = ∫ P ( x ) d x + C \int Q(y)dy = \int P(x)dx + C ∫ Q ( y ) d y = ∫ P ( x ) d x + C
First Order Linear ODE
y ′ + p ( x ) y = q ( x ) y' + p(x)y = q(x) y ′ + p ( x ) y = q ( x )
The Method of Integrating Factors
μ ( x ) = e ∫ p ( x ) d x \mu(x) = e^{\int p(x)dx} μ ( x ) = e ∫ p ( x ) d x
y ( x ) = 1 μ ( x ) [ ∫ μ ( x ) q ( x ) d x + C ] y(x) = \frac{1}{\mu(x)} [\int \mu(x)q(x)dx + C] y ( x ) = μ ( x ) 1 [ ∫ μ ( x ) q ( x ) d x + C ]
Modeling
y ′ = a y + b y' = ay + b y ′ = a y + b
y = ( y 0 + b a ) e a x − b a y = (y_0 + \frac{b}{a})e^{ax} - \frac{b}{a} y = ( y 0 + a b ) e a x − a b
y ′ = k y y' = ky y ′ = k y
y = y 0 e k t y = y_0e^{kt} y = y 0 e k t
Logistic Equation
y ′ = r y ( 1 − y L ) y' = ry(1-\frac{y}{L}) y ′ = r y ( 1 − L y )
y = L A A + e − r t , A = y 0 L − y 0 y = \frac{LA}{A+e^{-rt}}, A = \frac{y_0}{L-y_0} y = A + e − r t L A , A = L − y 0 y 0
y = 0 y = 0 y = 0 is unstable
y = L y = L y = L is asymptotically stable
Autonomous ODE
y ′ = F ( y ) y'=F(y) y ′ = F ( y )
y ( t ) = a , F ( a ) = 0 y(t) = a, F(a)=0 y ( t ) = a , F ( a ) = 0 are equilibrium solutions.
Phase Diagram:
The sign of F ( y ) F(y) F ( y ) indicates increasing or decreasing.
Classification of Equilibria:
F ′ ( a ) < 0 F'(a) < 0 F ′ ( a ) < 0 asymptotically stable
F ′ ( a ) > 0 F'(a) > 0 F ′ ( a ) > 0 unstable
F ′ ( a ) = 0 F'(a) = 0 F ′ ( a ) = 0 semi-stable or no conclusion
Existence and Uniqueness Theorem for Linear ODE
y ′ + p ( t ) y = q ( t ) , y ( t 0 ) = y 0 y' + p(t)y = q(t), y(t_0) = y_0 y ′ + p ( t ) y = q ( t ) , y ( t 0 ) = y 0
p ( t ) p(t) p ( t ) and q ( t ) q(t) q ( t ) are continuous functions and t 0 t_0 t 0 is on that interval.
y ′ = F ( t , y ) , y ( t 0 ) = y 0 y' = F(t, y), y(t_0) = y_0 y ′ = F ( t , y ) , y ( t 0 ) = y 0
F , d F d y F, \frac{dF}{dy} F , d y d F are continuous.
Euler's Method
y = y 0 + F ( x 0 , y 0 ) ( x − x 0 ) y = y_0 + F(x_0, y_0)(x - x_0) y = y 0 + F ( x 0 , y 0 ) ( x − x 0 )
Second Order Linear ODE
y ′ ′ + p ( t ) y ′ + q ( t ) y = g ( t ) y'' + p(t)y' + q(t)y = g(t) y ′′ + p ( t ) y ′ + q ( t ) y = g ( t )
p , q , g p, q, g p , q , g are continuous functions.
Constant Coefficients
Homogeneous
a y ′ ′ + b y ′ + c y = 0 ay'' + by' + cy = 0 a y ′′ + b y ′ + cy = 0
Superposition Principle: y = c 1 y 1 + c 2 y 2 y = c_1y_1 + c_2y_2 y = c 1 y 1 + c 2 y 2 , y = y h + y p y = y_h + y_p y = y h + y p
Wronskian: W ( y 1 , y 2 ) = ∣ y 1 ( t 0 ) y 2 ( t 0 ) y 1 ′ ( t 0 ) y 2 ′ ( t 0 ) ∣ W(y_1, y_2) = \begin{vmatrix} y_1(t_0) & y_2(t_0) \\ y_1'(t_0) & y_2'(t_0) \end{vmatrix} W ( y 1 , y 2 ) = y 1 ( t 0 ) y 1 ′ ( t 0 ) y 2 ( t 0 ) y 2 ′ ( t 0 )
Characteristic Equation: a r 2 + b r + c = 0 ar^2 + br + c = 0 a r 2 + b r + c = 0
y = [ e r 1 t , e r 2 t ] y = [e^{r_1t},\ e^{r_2t}] y = [ e r 1 t , e r 2 t ]
y = [ e r t , t e r t ] y = [e^{rt},\ te^{rt}] y = [ e r t , t e r t ]
r = λ ± i μ r = \lambda \pm i\mu r = λ ± i μ , then y = [ e λ t cos μ t , e λ t sin μ t ] y = [e^{\lambda t}\cos\mu t,\ e^{\lambda t}\sin\mu t] y = [ e λ t cos μ t , e λ t sin μ t ]
Euler's Formula: e i θ = cos θ + i sin θ e^{i\theta} = \cos\theta + i\sin\theta e i θ = cos θ + i sin θ , e i π + 1 = 0 e^{i\pi} + 1 = 0 e iπ + 1 = 0
Amplitude and Phase Angle:
c 1 cos ( ω t ) + c 2 sin ( ω t ) = A cos ( ω t − θ ) A = c 1 2 + c 2 2 , cos θ = c 1 c 1 2 + c 2 2 c_1\cos(\omega t) + c_2\sin(\omega t) = A\cos(\omega t - \theta) \\
A = \sqrt{c_1^2 + c_2^2},\ \cos\theta = \frac{c_1}{\sqrt{c_1^2 + c_2^2}} c 1 cos ( ω t ) + c 2 sin ( ω t ) = A cos ( ω t − θ ) A = c 1 2 + c 2 2 , cos θ = c 1 2 + c 2 2 c 1
Inhomogeneous
Undetermined Coefficients
g ( t ) g(t) g ( t ) is
polynomial, y p = A 0 + A 1 t + ⋯ + A n t n y_p = A_0+A_1t+\dots+A_nt^n y p = A 0 + A 1 t + ⋯ + A n t n
exponential, y p = A e α t y_p = Ae^{\alpha t} y p = A e α t
trigonometric, y p = A sin β t + B cos β t y_p = A\sin\beta t + B\cos\beta t y p = A sin β t + B cos β t
When exception happens, multiply by t t t
Variation of Parameters
Assumption: v 1 ′ y 1 + v 2 ′ y 2 = 0 v_1'y_1 + v_2'y_2 = 0 v 1 ′ y 1 + v 2 ′ y 2 = 0
y p = v 1 y 1 + v 2 y 2 y_p = v_1y_1 + v_2y_2 y p = v 1 y 1 + v 2 y 2
W = y 1 y 2 ′ − y 2 y 1 ′ v 1 = − ∫ y 2 g W d t v 2 = ∫ y 1 g W d t W = y_1y_2' - y_2y_1' \\
v_1 = -\int\frac{y_2g}{W}dt \\
v_2 = \int\frac{y_1g}{W}dt \\ W = y 1 y 2 ′ − y 2 y 1 ′ v 1 = − ∫ W y 2 g d t v 2 = ∫ W y 1 g d t
Modelling
Spring Mass System: m x ′ ′ + r x ′ + k x = F ( t ) mx'' + rx' + kx = F(t) m x ′′ + r x ′ + k x = F ( t )
RLC Circuit: L Q ′ ′ + R Q ′ + 1 C Q = E ( t ) LQ'' + RQ' + \frac{1}{C}Q = E(t) L Q ′′ + R Q ′ + C 1 Q = E ( t )
High Order Linear ODE with constant coefficients are the same with second order.
First Order Systems of ODEs
x ′ = A x + g x' = Ax + g x ′ = A x + g
Matrix A A A 's eigenvalues and eigenvectors are r 1 , v 1 r_1, v_1 r 1 , v 1 and r 2 , v 2 r_2, v_2 r 2 , v 2
x = [ e r 1 t v 1 ⃗ , e r 2 t v 2 ⃗ ] x = [e^{r_1t}\vec{v_1},\ e^{r_2t}\vec{v_2}] x = [ e r 1 t v 1 , e r 2 t v 2 ]
r , v , u r, v, u r , v , u
( A − r I ) u = v (A-rI)u = v ( A − r I ) u = v
x = [ e r t v , e r t ( t v + u ) ] x = [e^{rt}v, e^{rt}(tv + u)] x = [ e r t v , e r t ( t v + u )]
r 1 , 2 = λ ± i μ r_{1,2} = \lambda\pm i\mu r 1 , 2 = λ ± i μ and v ⃗ 1 , 2 = a ⃗ ± i b ⃗ \vec{v}_{1,2} = \vec{a}\pm i\vec{b} v 1 , 2 = a ± i b , then
x 1 = e λ t [ cos ( μ t ) a ⃗ − sin ( μ t ) b ⃗ ] x 2 = e λ t [ sin ( μ t ) a ⃗ + cos ( μ t ) b ⃗ ] x_1 = e^{\lambda t}[\cos(\mu t)\vec{a} - \sin(\mu t)\vec{b}] \\
x_2 = e^{\lambda t}[\sin(\mu t)\vec{a} + \cos(\mu t)\vec{b}] x 1 = e λ t [ cos ( μ t ) a − sin ( μ t ) b ] x 2 = e λ t [ sin ( μ t ) a + cos ( μ t ) b ]
Phase Portrait: test ( 1 0 ) \begin{pmatrix} 1 \\ 0 \end{pmatrix} ( 1 0 ) , x 2 ′ > 0 x_2' > 0 x 2 ′ > 0 : counterclockwise; x 2 ′ < 0 x_2' < 0 x 2 ′ < 0 : clockwise
test the first column or A A A , A 2 , 1 > 0 A_{2,1} > 0 A 2 , 1 > 0 : counterclockwise; A 2 , 1 < 0 A_{2,1} < 0 A 2 , 1 < 0 : clockwise
Stability of equilibria
Real eigenvalues
r 1 , r 2 < 0 r_1, r_2 < 0 r 1 , r 2 < 0 , asymptotically stable node
r 1 , r 2 > 0 r_1, r_2 > 0 r 1 , r 2 > 0 , unstable node
r 1 r 2 < 0 r_1r_2 < 0 r 1 r 2 < 0 , unstable saddle
Complex eigenvalues
λ = 0 \lambda = 0 λ = 0 , stable center
λ < 0 \lambda < 0 λ < 0 , spiral sink
λ > 0 \lambda > 0 λ > 0 , spiral source
High order linear DEs can be transformed to first order linear system.
Nonhomogenous
If g g g is a constant vector, a particular equilibrium solution is x p = − A − 1 g x_p = -A^{-1}g x p = − A − 1 g
Undetermined Coefficients
Variation of Parameters
The fundamental matrix of homogeneous is Φ ( t ) \Phi(t) Φ ( t )
μ = ∫ Φ − 1 g d t \mu = \int \Phi^{-1}g dt μ = ∫ Φ − 1 g d t
x p = Φ μ x_p = \Phi \mu x p = Φ μ
Autonomous
x ′ ⃗ = A x ⃗ + g ⃗ = 0 \vec{x'} = A\vec{x} + \vec{g} = 0 x ′ = A x + g = 0
The stability can be determined by A A A
Nonlinear Autonomous System of DEs
x ′ = f ( x , y ) y ′ = g ( x , y ) x' = f(x, y) \\
y' = g(x, y) \\ x ′ = f ( x , y ) y ′ = g ( x , y )
A = [ f x ( x 0 , y 0 ) f y ( x 0 , y 0 ) g x ( x 0 , y 0 ) g y ( x 0 , y 0 ) ] A =
\begin{bmatrix}
f_x(x_0, y_0) & f_y(x_0, y_0) \\
g_x(x_0, y_0) & g_y(x_0, y_0) \\
\end{bmatrix} A = [ f x ( x 0 , y 0 ) g x ( x 0 , y 0 ) f y ( x 0 , y 0 ) g y ( x 0 , y 0 ) ]
Boundary Value Problem
y ( a ) = y 0 , y ( b ) = y 1 y(a) = y_0, y(b) = y_1 y ( a ) = y 0 , y ( b ) = y 1
nonhomogeneous has unique solution ↔ homogeneous has only trivial solution
nonhomogeneous has no/infinite solution ↔ homogeneous has nontrivial solution