Historical Context & Motivation
For centuries, scientists and mathematicians have tried to describe patterns in data using equations. The simplest approach — drawing a straight line — works remarkably well for many situations, but the real world doesn't always follow a straight path. A ball tossed into the air, the spread of a rumor through a school, or the braking distance of a car at different speeds all trace curves rather than lines. Recognizing when a line is adequate and when a curve is needed has been a driving question in statistics since its earliest days.
The central question this lesson addresses is deceptively simple: given a set of data, should you model it with a line or a parabola, and how do you defend that choice? Answering this requires both mathematical tools (like R² and residual plots) and conceptual reasoning about what the data actually represents.
Core Principles & Definitions
Before you can compare two models, you need to understand the vocabulary and the key ideas behind model fitting. A model is simply an equation that attempts to describe the relationship between two variables. When we say a model "fits" data well, we mean its predicted values are consistently close to the actual data points. The following principles form the foundation of model comparison.
Linear Model
Quadratic Model
Residuals
Residual Plot
R² (Coefficient of Determination)
Visual Explanation — Seeing the Difference
The most powerful way to understand model comparison is to look at the same data with two different models overlaid on it, and then examine the residual plots side by side. The diagram below shows a scatter plot of braking distance versus car speed. A linear fit is shown in blue, and a quadratic fit is shown in violet. Notice how the linear model systematically misses the data at low and high speeds.
In the diagram above, the linear model appears to underpredict braking distance at both low and high speeds while overpredicting in the middle range. This U-shaped pattern of error is a classic sign that the relationship between the variables is curved, not straight. The quadratic model, by contrast, hugs the data much more tightly because it accounts for the increasing rate at which braking distance grows as speed rises.
Mathematical Framework
Two mathematical tools are essential for comparing model fits: the residual and the coefficient of determination (R²). Understanding how each is calculated will help you use them with confidence.
Residual Plots — The Deciding Factor
The single most important visual tool for comparing model fits is the residual plot. When a model fits the data well, its residuals should look like a random scatter of points above and below the horizontal line at zero — no pattern, no trend, no curve. When you see a clear pattern in the residual plot, it means your model is systematically missing something. The diagram below shows two residual plots for the same data: one from a linear model and one from a quadratic model.
The left residual plot reveals a telltale U-shaped pattern: the residuals are positive at the ends and negative in the middle. This curved pattern is exactly what you expect when you force a straight line onto data that is actually curved. The quadratic residual plot on the right, by contrast, shows no systematic pattern — the points bounce above and below zero in an essentially random way, which is exactly what a well-fitting model should produce.
- Pattern in residuals → The model is missing a feature of the data. Try a different model.
- Random scatter in residuals → The model captures the main trend. The fit is appropriate.
- Increasing spread (fan shape) → The model may fit the trend, but predictions become less reliable for larger x-values.
Worked Example — Choosing the Better Model
A physics class measures the height of a ball (in feet) at various times (in seconds) after it is launched upward. The data are shown below. Two regressions are computed: a linear model and a quadratic model. Let's walk through how to decide which model fits better.
| Time (s) | Height (ft) |
|---|---|
| 0 | 4 |
| 0.5 | 20 |
| 1.0 | 28 |
| 1.5 | 30 |
| 2.0 | 24 |
| 2.5 | 12 |
| 3.0 | 0 |
Strengths & Limitations of Each Model Type
Neither the linear model nor the quadratic model is universally "better." Each has strengths in certain situations and weaknesses in others. The table below summarizes when to reach for each.
| Feature | Linear Model | Quadratic Model |
|---|---|---|
| Shape of fit | Straight line | Parabola (U or inverted U) |
| Best when data shows… | Constant rate of change | Changing rate of change (acceleration or deceleration) |
| Number of parameters | 2 (slope, intercept) | 3 (a, b, c) |
| Extrapolation risk | Moderate — continues in same direction | High — parabola may curve wildly outside the data range |
| Simplicity | Simple and easy to interpret | Slightly more complex; vertex and direction matter |
| Common real-world examples | Cost per item, hourly wages, temperature rising at a constant rate | Projectile motion, profit optimization, braking distance |
Connection to Advanced Model Fitting
The skills you are building now — comparing two models using residuals, R², and conceptual reasoning — are the same skills used in advanced statistics and data science. In future courses, you will encounter exponential, logarithmic, and sinusoidal models, and you will use more sophisticated criteria to choose among them. The table below previews how the tools you know now extend into higher-level work.
| Concept Now | Advanced Version |
|---|---|
| R² to compare two models | Adjusted R² — penalizes adding unnecessary parameters so you can fairly compare models with different numbers of terms |
| Residual plot (visual check) | Formal residual diagnostics — statistical tests for normality, homoscedasticity, and independence of residuals |
| Linear vs quadratic | Multiple regression, polynomial regression, and non-linear models (exponential, logistic, etc.) |
| Conceptual justification | Model selection criteria such as AIC and BIC, which balance fit quality with model complexity |
The core philosophy never changes, no matter how advanced the statistics get: the best model is the simplest one that adequately captures the pattern in the data and makes sense in context. This idea is sometimes called the principle of parsimony, and it will guide your work in AP Statistics, college-level courses, and professional data analysis.
Practice Problems
Lesson Summary
When deciding between a linear model (y = ax + b) and a quadratic model (y = ax² + bx + c), use three complementary tools. First, compare R² values — the model with the higher R² explains more of the variation in the data. Second, examine the residual plots — a random scatter around zero signals a good fit, while a U-shaped or curved pattern signals the model is missing curvature in the data. Third, apply conceptual reasoning — ask whether the real-world situation logically involves a constant rate of change (linear) or a changing rate of change (quadratic).
Always start with the simpler linear model and only move to the quadratic model if the data, the residuals, and the context all point toward curvature. A tiny R² improvement with no residual pattern change does not justify added complexity. The guiding principle is parsimony — choose the simplest model that adequately captures the trend and makes sense in the real world.