DIFFERENTIAL EQUATIONS • SERIES AND NUMERICAL METHODS

Series Solutions: Ordinary Points — Series Solutions Near Ordinary Points (Intro)

When standard techniques fail, power series unlock solutions to differential equations that resist closed-form answers.

Historical Context & Motivation

📌 Note on Prerequisites
This lesson assumes you have completed Calculus I and II, including power series, Taylor series, and summation notation, along with an introduction to second-order linear ordinary differential equations. Key definitions are reviewed as they appear, but comfort with series convergence will help you move through the material efficiently.

Throughout the history of mathematics, scientists and engineers have encountered differential equations that simply could not be solved using standard algebraic techniques. A differential equation is an equation that involves an unknown function and its derivatives — for example, an equation that says something about how fast a quantity changes. Methods like separation of variables or integrating factors work beautifully for certain simple types, but many important equations in physics and engineering resist these approaches entirely. The question arose: how can we find solutions when our usual toolkit breaks down?

The answer came from the world of power series — infinite sums of terms of the form a₀ + a₁x + a₂x² + a₃x³ + ⋯, similar to polynomials but with infinitely many terms. You've seen this idea in calculus when studying Taylor series. Mathematicians realized that even when a differential equation has no neat closed-form solution like y = e^x or y = sin(x), you can often express the solution as an infinite series. This breakthrough opened up entire families of equations to analysis.

1715
Taylor's Series Formalization
Brook Taylor publishes his work on representing functions as infinite polynomial sums, laying the foundation for power series methods.
1768
Euler's Series Techniques
Leonhard Euler applies power series to solve differential equations arising in mechanics, demonstrating the practical power of these infinite expansions.
1866
Fuchs' Classification
Lazarus Fuchs systematically classifies the behavior of differential equations near their singular and ordinary points, distinguishing where series methods work reliably.
1874
Frobenius Method
Ferdinand Georg Frobenius extends series solution techniques to handle equations near regular singular points, greatly expanding the method's reach.

The central question that this lesson addresses is deceptively simple: given a differential equation that we cannot solve with familiar techniques, how do we assume a power series form for the solution and systematically determine its coefficients? And crucially, how do we know when this approach is guaranteed to work? The concept of an ordinary point provides the answer.

Core Principles & Definitions

Before we can use series to solve differential equations, we need to understand a few key ideas. These definitions tell us when the method works and how to set it up properly. Think of them as a checklist you run through before starting the actual computation. Each term is defined below, and they build on one another, so it helps to read them in order.

1

Power Series

An infinite sum of the form a₀ + a₁(x − x₀) + a₂(x − x₀)² + ⋯, written compactly as Σ aₙ(x − x₀)ⁿ, where each aₙ is a constant. It works like an infinitely long polynomial centered at the point x₀. You've seen examples like 1 + x + x²/2! + x³/3! + ⋯ = eˣ.
2

Analytic Function

A function is called analytic at a point x₀ if it can be represented by a convergent power series near that point. In practice, polynomials, sin(x), cos(x), and eˣ are analytic everywhere. A rational function like 1/(x − 2) is analytic everywhere except at x = 2, where it blows up.
3

Ordinary Point

A point x₀ where the coefficient functions P(x) and Q(x) in the standard form y″ + P(x)y′ + Q(x)y = 0 are both analytic (representable by their own convergent power series). The series solution method is guaranteed to work at an ordinary point.
4

Singular Point

A point x₀ where P(x) or Q(x) is not analytic — typically where a denominator equals zero. Standard power series methods do not directly apply at singular points; a more advanced technique (the Frobenius method) is needed there.
5

Radius of Convergence

A power series only 'works' (converges to a finite value) within a certain distance from its center x₀. That distance is the radius of convergence. At an ordinary point, the series solution is guaranteed to converge at least up to the nearest singular point of the equation.
6

Recurrence Relation

A formula that expresses each coefficient aₙ in terms of earlier coefficients — for example, a_{n+2} = −aₙ/[(n+2)(n+1)]. This is the engine that drives the series solution: once you find it, you can compute as many terms as you need by repeatedly applying the formula.
KEY TAKEAWAY
Think of a power series solution like building a custom playlist one song at a time. You start with a basic beat (the first coefficient a₀), and each new term you add refines the overall sound. The recurrence relation is the rule that tells you exactly which song to add next based on the ones already in the playlist. An ordinary point is like a smooth stretch of road — you're guaranteed to make progress. A singular point is a roadblock where you need a different vehicle.

Visualizing the Series Solution Process

The diagram below shows the overall workflow of finding a series solution near an ordinary point. Understanding this flowchart will guide you through every problem of this type. Each stage builds on the previous one, so the order matters.

The flowchart traces the four main steps: verify the point is ordinary, assume a series form, substitute into the equation, and extract a recurrence relation. Notice the branch — if the point is not ordinary, a different method (Frobenius) is needed.

Notice how the entire process is systematic. You don't need to guess or be creative — each step follows logically from the previous one. The hardest part is usually Step 3, where you align powers of (x − x₀) using index shifts (re-labeling the counting variable in a sum so that both sums contain the same power of x). We'll walk through that in detail in the worked example later.

Mathematical Framework

Let's lay out the key equations you'll use. We begin with a second-order linear ODE — an equation involving an unknown function y, its first derivative y′ (rate of change), and its second derivative y″ (rate of change of the rate of change) — and convert it into a form where the series approach can be applied. We introduce each definition carefully, since precision here is exactly what guarantees the method works.

STANDARD FORM
y″ + P(x) y′ + Q(x) y = 0
This is the standard form of a second-order linear homogeneous ODE. The leading coefficient of y″ must be 1. If your equation is a₂(x)y″ + a₁(x)y′ + a₀(x)y = 0, divide every term by a₂(x) first.
ORDINARY POINT CONDITION
x₀ is ordinary if P(x) and Q(x) are analytic at x₀
In practice, P(x) and Q(x) are analytic at x₀ when they can be expanded as convergent power series around x₀. For rational functions (fractions of polynomials), this simply means x₀ is not a root of any denominator — i.e., no division by zero occurs at x₀.
ASSUMED SERIES SOLUTION
y = Σ (n=0 to ∞) aₙ(x − x₀)ⁿ = a₀ + a₁(x − x₀) + a₂(x − x₀)² + ⋯
Here, aₙ are unknown coefficients we need to determine. The constants a₀ and a₁ typically remain as free parameters and correspond to the two arbitrary constants in the general solution of a second-order ODE — similar to how a second-order equation from physics (like Newton's second law) needs two initial conditions (initial position and initial velocity) to pin down the specific solution.
DERIVATIVES OF THE SERIES
y′ = Σ (n=1 to ∞) n·aₙ(x − x₀)ⁿ⁻¹, y″ = Σ (n=2 to ∞) n(n−1)·aₙ(x − x₀)ⁿ⁻²
We differentiate the series term by term, just as you would differentiate a polynomial one term at a time. Notice that the starting index shifts: y′ starts at n = 1 (since the a₀ constant term has derivative zero), and y″ starts at n = 2.
💡 Why Two Free Constants?
A second-order ODE always has a general solution with two arbitrary constants. In the series method, these constants are a₀ and a₁. The recurrence relation expresses every later coefficient (a₂, a₃, a₄, …) in terms of a₀ and a₁. When you apply initial conditions y(x₀) = C₁ and y′(x₀) = C₂, you simply set a₀ = C₁ and a₁ = C₂.

Identifying Ordinary vs. Singular Points

Before you invest time in a series solution, you need to determine whether your chosen center x₀ is an ordinary point. This classification is the most important preliminary step. The key practical rule: write the equation in standard form (y″ + P(x)y′ + Q(x)y = 0), then check whether P(x) and Q(x) are defined and well-behaved (analytic) at x₀. For most equations you'll encounter, this simply means checking that no denominator equals zero at x₀. The diagram below compares several common differential equations and identifies the nature of key points.

The number line for each equation marks ordinary points in green and singular points in red. For Equation 3 (a Legendre-type equation), the singular points at x = ±1 determine the radius of convergence for a series centered at x₀ = 0.

The key practical takeaway from this classification is the minimum radius of convergence. When you find a series solution at an ordinary point x₀, that series is guaranteed to converge in an interval whose radius extends at least to the nearest singular point. For Equation 3 above, centering the series at x₀ = 0 gives a minimum radius of convergence of 1, since the nearest singular points are at x = −1 and x = 1 (both at distance 1 from 0).

Classification of several standard differential equations
Equation (Standard Form)Singular Pointsx₀ = 0 StatusMin. Radius of Convergence at x₀ = 0
y″ + xy′ + y = 0NoneOrdinary
y″ + (1/x)y′ + y = 0x = 0SingularN/A (use Frobenius)
(1−x²)y″ − 2xy′ + 6y = 0x = ±1Ordinary1
x²y″ + xy′ + (x²−1)y = 0x = 0SingularN/A (use Frobenius)

Worked Example: Solving y″ + y = 0 via Power Series

Let's apply the series method to an equation whose answer we already know: y″ + y = 0. We know the solutions are sin(x) and cos(x), but let's see how the series approach recovers them. This builds confidence in the method before we tackle unfamiliar equations. The notation Σ (n=0 to ∞) means we sum over all whole numbers n starting from 0; think of it as adding up infinitely many terms according to a pattern.

Find the general series solution of y″ + y = 0 about x₀ = 0
1
Step 1 — Verify x₀ = 0 is an Ordinary PointThe equation is already in standard form: y″ + 0·y′ + 1·y = 0. Here P(x) = 0 and Q(x) = 1, which are both constant functions and therefore analytic (well-behaved) everywhere. So x₀ = 0 is an ordinary point, and a power series solution is guaranteed to exist with infinite radius of convergence (there are no singular points at all to limit convergence).
x₀ = 0 is ordinary; radius of convergence = ∞
2
Step 2 — Assume a Power SeriesWe assume y = Σ (n=0 to ∞) aₙxⁿ = a₀ + a₁x + a₂x² + a₃x³ + ⋯. Computing the derivatives term by term (just as with a polynomial): y′ = Σ (n=1 to ∞) naₙxⁿ⁻¹ = a₁ + 2a₂x + 3a₃x² + ⋯ and y″ = Σ (n=2 to ∞) n(n−1)aₙxⁿ⁻² = 2a₂ + 6a₃x + 12a₄x² + ⋯.
3
Step 3 — Substitute into the ODESubstituting into y″ + y = 0 gives: Σ (n=2 to ∞) n(n−1)aₙxⁿ⁻² + Σ (n=0 to ∞) aₙxⁿ = 0. To combine these sums, we need the same power of x in each. The first sum has powers xⁿ⁻²; the second has powers xⁿ. We re-label the index in the first sum: let m = n − 2, so n = m + 2. When n = 2, m = 0. The first sum becomes: Σ (m=0 to ∞) (m+2)(m+1)a_{m+2} xᵐ. Renaming m back to n (just a label change): Σ (n=0 to ∞) [(n+2)(n+1)a_{n+2} + aₙ] xⁿ = 0.
4
Step 4 — Set Each Coefficient to ZeroSince this must hold for all x, the coefficient of each xⁿ must individually equal zero (just as two polynomials are equal only if every matching coefficient is equal): (n+2)(n+1)a_{n+2} + aₙ = 0 for all n ≥ 0. Solving for a_{n+2}: a_{n+2} = −aₙ / [(n+2)(n+1)].
Recurrence relation: a_{n+2} = −aₙ / [(n+2)(n+1)]
5
Step 5 — Compute CoefficientsStarting with the free constants a₀ and a₁: • a₂ = −a₀/(2·1) = −a₀/2 • a₃ = −a₁/(3·2) = −a₁/6 • a₄ = −a₂/(4·3) = a₀/24 • a₅ = −a₃/(5·4) = a₁/120 • a₆ = −a₄/(6·5) = −a₀/720 The pattern separates into even-indexed terms (involving a₀) and odd-indexed terms (involving a₁).
6
Step 6 — Write the General Solutiony = a₀(1 − x²/2! + x⁴/4! − x⁶/6! + ⋯) + a₁(x − x³/3! + x⁵/5! − ⋯). We recognize the first series as the Taylor series for cos(x) and the second as the Taylor series for sin(x) — confirming that the power series method recovers the familiar solutions.
y = a₀ cos(x) + a₁ sin(x) ✓
⚠️ The Index Shift Trick
The most common stumbling block is Step 3 — the index shift. When you see xⁿ⁻² in one sum and xⁿ in another, you need to re-index so both have the same power. Think of it like converting currencies: you need everything in the same units before you can combine. Substitute m = n − 2 in the first sum, find the new starting value, then rename m back to n.

Strengths, Limitations & Comparisons

The power series method is a powerful tool, but like any method, it has situations where it shines and situations where it struggles. Understanding these helps you choose the right approach for each problem.

Power Series Method: Strengths vs. Limitations
StrengthsLimitations
Works when standard methods (undetermined coefficients, variation of parameters) failOnly guaranteed at ordinary points; singular points require the Frobenius method
Produces a general solution with two arbitrary constantsResult is an infinite series, not always a recognizable closed-form function
Systematic and algorithmic — no guesswork neededAlgebra can become tedious for equations with non-constant P(x), Q(x)
Guaranteed convergence within a known radiusSeries may converge slowly, requiring many terms for numerical accuracy
Can handle variable-coefficient equations that are common in physicsDoes not directly apply to nonlinear differential equations
🔑 WHEN TO USE THIS METHOD
Use series solutions when you have a linear ODE with variable coefficients that resists all your other techniques. Think of it as your all-terrain vehicle: it may not be the fastest on a smooth highway (constant-coefficient equations), but it can go places no other vehicle can reach. As long as you're at an ordinary point, the engine starts up and gets you to a solution.

Connection to Advanced Theory

The series solution at ordinary points is just the beginning of a larger family of techniques studied in Differential Equations. Understanding where this introductory method fits helps you see the bigger picture and prepares you for more advanced topics you will encounter later in the course and in upper-level mathematics and physics.

Comparison: Ordinary Point vs. Frobenius Method
FeatureSeries at Ordinary Points (This Lesson)Frobenius Method (Next Topic)
Point typeOrdinary point onlyRegular singular point
Assumed formy = Σ aₙ(x − x₀)ⁿy = xʳ Σ aₙxⁿ (extra xʳ factor, r found from an auxiliary equation)
Extra equation neededNone — just a recurrence relationIndicial equation determines the exponent r before the recurrence relation can be found
Number of series solutionsAlways two independent solutionsSometimes only one series solution; a second may involve logarithmic terms
Famous examplesAiry equation, Hermite equation, Legendre equationBessel equation, hypergeometric equation

Many of the most important functions in science — Bessel functions (used to model wave patterns in cylinders and heat flow), Legendre polynomials (used in gravitational field calculations), and Hermite polynomials (used in quantum mechanics to describe electron behavior) — were originally discovered through series solution techniques. These functions don't have simple formulas like sin or eˣ, but their series representations make them fully computable and well understood. Mastering the ordinary-point method is the essential first step toward working with these powerful tools in physics and engineering.

🚀 Looking Ahead
Once you're comfortable with series solutions at ordinary points, the Frobenius method extends the same idea to regular singular points by assuming y = xʳ Σ aₙxⁿ. The new twist is an "indicial equation" — a small auxiliary equation that determines the exponent r before you can find the recurrence relation. The core logic is exactly the same substitution-and-match process you've already learned here.

Practice Problems

PROBLEM 1CONCEPTUAL
Consider the equation y″ + (x/(x² − 4))y′ + (1/(x − 2))y = 0. Is x₀ = 0 an ordinary point? Identify all singular points and state the minimum radius of convergence for a series solution centered at x₀ = 0.
PROBLEM 2BASIC CALCULATION
For the equation y″ − y = 0 with y = Σ aₙxⁿ, substitute the series into the equation and derive the recurrence relation.
PROBLEM 3INTERMEDIATE
Find the first four nonzero terms of the series solution to y″ + xy = 0 about x₀ = 0. This is the Airy equation, whose solutions cannot be written in terms of elementary functions.
PROBLEM 4APPLIED
The Hermite equation y″ − 2xy′ + 2λy = 0 arises in quantum mechanics (the quantum harmonic oscillator). For λ = 2, use a power series centered at x₀ = 0 to find the recurrence relation and compute the first three terms of each independent solution.
PROBLEM 5CRITICAL THINKING
Suppose you are given y″ + P(x)y′ + Q(x)y = 0 where P(x) = 1/(x − 3) and Q(x) = x². You want a series solution centered at x₀ = 1. (a) Is x₀ = 1 ordinary? (b) What is the minimum guaranteed radius of convergence? (c) Could the series actually converge on a larger interval than guaranteed? Explain why or why not.

Lesson Summary

This lesson introduces series solutions of differential equations, a technique for solving second-order linear ODEs whose variable coefficients rule out standard methods. When a second-order linear ODE y″ + P(x)y′ + Q(x)y = 0 has variable coefficients that prevent standard solution methods, a power series solution y = Σ aₙ(x − x₀)ⁿ can be assumed. The method works reliably at an ordinary point — a value x₀ where both P(x) and Q(x) are analytic (well-behaved, with no division-by-zero issues). To classify a point, first write the equation in standard form (leading coefficient of y″ equal to 1), then check whether P(x₀) and Q(x₀) are defined and analytic.

The solution procedure is systematic: assume a series, compute its derivatives, substitute into the ODE, align powers of x using index shifts (re-labeling the summation variable so both sums contain the same power of x), and set each coefficient of xⁿ to zero to obtain a recurrence relation. The free constants a₀ and a₁ generate two independent solutions. The series converges at least up to the nearest singular point, giving a guaranteed minimum radius of convergence. This technique is the gateway to more advanced methods — including the Frobenius method — and to important special functions such as Legendre polynomials, Bessel functions, and Hermite polynomials that appear throughout physics and engineering.

Varsity Tutors • Differential Equations • Series Solutions: Ordinary Points — Series Solutions Near Ordinary Points (Intro)