Chapter 4: Systems of Differential Equations

Understanding coupled differential equations and their behavior in engineering applications

Learning Objectives

Understand the fundamental concept of systems of linear differential equations
Convert higher-order differential equations into first-order systems
Recognize and solve homogeneous linear systems using matrix methods
Analyze stability and long-term behavior of solutions using phase portraits
Apply systems of differential equations to model real-world engineering problems
Interpret eigenvalues and eigenvectors in the context of system dynamics

"The trajectory of a system does not reveal the forces acting upon the system." — Henri Poincaré

مَنْ سَلَكَ طَرِيقًا يَلْتَمِسُ فِيهِ عِلْمًا سَهَّلَ اللَّهُ لَهُ بِهِ طَرِيقًا إِلَى الْجَنَّةِ

"Whoever treads a path seeking knowledge therein, Allah will ease a path to Paradise for him."

— Prophet Muhammad (PBUH), Sahih Muslim 2699

What is a System of Differential Equations?

A system of differential equations is a set of two or more differential equations involving multiple unknown functions and their derivatives. Rather than studying how a single quantity changes over time, systems allow us to model how multiple interrelated quantities evolve together.

General Matrix Form

A system of $n$ first-order linear differential equations can be written in compact matrix form as:

\mathbf{x}' = A\mathbf{x}

where:

$\mathbf{x} = \begin{pmatrix} x_1(t) \\ x_2(t) \\ \vdots \\ x_n(t) \end{pmatrix}$ is the state vector
$\mathbf{x}' = \begin{pmatrix} x_1'(t) \\ x_2'(t) \\ \vdots \\ x_n'(t) \end{pmatrix}$ is its derivative
$A = \begin{pmatrix} a_{11} & a_{12} & \cdots & a_{1n} \\ a_{21} & a_{22} & \cdots & a_{2n} \\ \vdots & \vdots & \ddots & \vdots \\ a_{n1} & a_{n2} & \cdots & a_{nn} \end{pmatrix}$ is an $n \times n$ constant coefficient matrix

A Concrete 2×2 Example

The simplest non-trivial case is a system of two first-order equations:

\frac{dx_1}{dt} = a_{11}x_1 + a_{12}x_2

\frac{dx_2}{dt} = a_{21}x_1 + a_{22}x_2

In matrix form, this becomes:

\begin{pmatrix} x_1' \\ x_2' \end{pmatrix} = \begin{pmatrix} a_{11} & a_{12} \\ a_{21} & a_{22} \end{pmatrix} \begin{pmatrix} x_1 \\ x_2 \end{pmatrix}

or simply $\mathbf{x}' = A\mathbf{x}$.

Key Insight

The coupling between equations is encoded in the off-diagonal elements of matrix $A$. If all off-diagonal elements are zero, the system decouples into independent equations that can be solved separately.

Why Study Systems of Differential Equations?

Systems of differential equations arise naturally in engineering and physics. They allow us to model complex phenomena where multiple variables influence each other. Let's explore several key motivations and applications.

Converting Higher-Order ODEs to Systems

Any higher-order differential equation can be rewritten as a system of first-order equations. This is crucial because our analytical and computational methods are often designed for first-order systems.

Example Conversion

Consider the second-order equation:

$$y'' + 3y' + 2y = 0$$

We introduce a new variable $x_2 = y'$, so $x_1 = y$. Then:

$$x_1' = x_2$$

$$x_2' = y'' = -3y' - 2y = -3x_2 - 2x_1$$

In matrix form:

\begin{pmatrix} x_1' \\ x_2' \end{pmatrix} = \begin{pmatrix} 0 & 1 \\ -2 & -3 \end{pmatrix} \begin{pmatrix} x_1 \\ x_2 \end{pmatrix}

Coupled Spring-Mass Systems

In mechanical engineering, we frequently encounter multiple masses connected by springs. Consider two masses $m_1$ and $m_2$ connected to each other and to fixed walls by springs with constants $k_1$, $k_2$, and $k_3$.

The equations of motion are derived from Newton's second law. The acceleration of each mass depends on the forces from springs attached to it:

m_1\frac{d^2x_1}{dt^2} = -k_1 x_1 + k_2(x_2 - x_1)

m_2\frac{d^2x_2}{dt^2} = -k_2(x_2 - x_1) - k_3 x_2

This is a coupled system: each mass's motion depends on the position of the other mass through the middle spring. We cannot solve for $x_1$ without knowing $x_2$, and vice versa.

Electrical Circuits with Multiple Loops

In circuit analysis, when we have multiple loops with resistors, capacitors, and inductors, Kirchhoff's voltage law applied to each loop yields a system of differential equations. The currents and voltages in one loop influence the others through shared components.

Population Dynamics: Predator-Prey Models

The Lotka-Volterra predator-prey model describes how predator and prey populations interact:

\frac{dx}{dt} = \alpha x - \beta xy

\frac{dy}{dt} = \delta xy - \gamma y

where $x$ is prey population and $y$ is predator population. The coupled nonlinear terms show how the growth of predators depends on encounters with prey, and how prey decline when predators are abundant.

Why Linear Systems Matter

While many real-world systems are nonlinear, understanding linear systems is essential because:

Exact solutions: We can find closed-form solutions using eigenvalues and eigenvectors
Local behavior: Nonlinear systems can be approximated by linear systems near equilibrium points
Stability analysis: Linear theory provides powerful tools for understanding long-term behavior
Computational efficiency: Linear systems are much faster to simulate and analyze numerically

Chapter Roadmap

This chapter is organized into three main topics, each building on the previous:

4.1 Matrices & Eigenvalues

Review of linear algebra concepts and their role in solving systems

4.2 Solving Homogeneous Systems

Finding the general solution using eigenvalues and eigenvectors

4.3 Phase Portraits & Stability

Visualizing and analyzing system behavior without solving explicitly

Interactive Phase Plane Visualization

Explore how different coefficient matrices produce different system behaviors. Select a system type below and observe the trajectories. Each curve represents the evolution of the system from a different initial condition.

System Type:

How to Interpret the Plot

Axes: $x_1$ and $x_2$ are the two state variables.
Curves: Each trajectory shows how the system evolves over time from different starting points.
Arrows: Direction of flow (how time progresses).
Behavior: Spiraling inward indicates stability; spiraling outward indicates instability; saddle points show attraction in one direction and repulsion in another.

Moving Forward

In the sections to come, you will learn how to:

4.1: Extract eigenvalues and eigenvectors from the coefficient matrix $A$
4.2: Construct the general solution from eigenvalues and eigenvectors
4.3: Use the eigenvalues to classify the long-term behavior of solutions without finding them explicitly

These tools will enable you to understand, predict, and control the behavior of coupled systems in your engineering practice.