AP STATISTICS • INFERENCE FOR QUANTITATIVE DATA: MEANS

Justifying a Claim About the Difference of Two Means Based on a Confidence Interval

Use confidence intervals to determine whether two population means differ and justify your reasoning with statistical evidence.

Historical Context & Motivation

Comparing two groups is one of the most fundamental tasks in empirical research. A physician might ask whether a new drug lowers blood pressure more than an existing treatment; an educator might investigate whether a revised curriculum raises test scores relative to the traditional approach. In each scenario, the core statistical question is the same: does a meaningful difference exist between two population means, or could the observed gap be attributable to random sampling variability? The intellectual lineage behind the confidence-interval approach to this question stretches across more than a century of statistical innovation.

1908
Student's t-Distribution
William Sealy Gosset, publishing under the pseudonym "Student," derived the t-distribution to handle small samples drawn from a normal population, replacing the need for large-sample z-approximations.
1935
Fisher's Design of Experiments
Ronald A. Fisher formalized experimental design principles—randomization, replication, and blocking—that made rigorous two-sample comparisons possible in agricultural and biological research.
1937
Welch's Approximate t-Test
Bernard L. Welch proposed an adjustment to the two-sample t-procedure that does not assume equal population variances, yielding the Welch–Satterthwaite degrees-of-freedom approximation now standard on AP Statistics.
1960s–1980s
Shift Toward Interval Estimation
Statisticians including John Tukey and the American Statistical Association increasingly advocated reporting confidence intervals alongside—or instead of—p-values, emphasizing the practical magnitude of effects.
2016–Present
ASA Statement on P-Values
The ASA's formal statement urged researchers to supplement significance tests with interval estimates, reinforcing the central role of confidence intervals in modern inference and AP curriculum design.

Against this historical backdrop, the AP Statistics curriculum asks a precise question: given a confidence interval for µ1 − µ2, how do we use that interval to justify a claim about whether the two population means are different, and in which direction? This lesson develops the conceptual framework, the mathematical machinery, and the interpretive language you need to answer confidently on exam day.

Core Principles & Definitions

Before constructing or interpreting a two-sample confidence interval, it is essential to anchor your understanding in a few foundational ideas. These principles govern when the procedure is valid, what the resulting interval means, and how you can leverage it to support or refute a claim about two populations.

1

Parameter of Interest: µ₁ − µ₂

The target parameter is the true difference between two population means. The point estimate is x̄₁ − x̄₂, calculated from independent random samples drawn from each population.
2

Sampling Distribution & Standard Error

Under the appropriate conditions, the sampling distribution of x̄₁ − x̄₂ is approximately normal. The standard error combines the variability from both samples: SE = √(s₁²/n₁ + s₂²/n₂).
3

Confidence Level & Margin of Error

A C% confidence interval captures the parameter in C% of all possible samples. The margin of error equals t* × SE, where t* comes from the t-distribution with the appropriate degrees of freedom.
4

Interpreting the Interval

If the interval contains 0, we lack convincing evidence that the means differ. If the entire interval is positive (or entirely negative), we have evidence of a directional difference at that confidence level.
5

Conditions for Inference

Three conditions must be verified: (1) Random—data from random samples or random assignment; (2) Independent—the 10% condition or independent groups; (3) Normal—sample sizes are large (n ≥ 30 each) or populations are approximately normal.
KEY TAKEAWAY
Think of a confidence interval for µ₁ − µ₂ as a net of plausible values cast over the unknown true difference. If your net catches zero, you cannot rule it out—there may be no real difference. If the net lands entirely on one side of zero, you have evidence that one population mean genuinely exceeds the other, much like a quality-control engineer who measures the gap between two machines' outputs and only declares one superior when the entire margin of uncertainty falls on one side.

Visual Explanation

A number line diagram is the most direct way to see whether a confidence interval for µ1 − µ2 supports a claim of a difference. The following diagram illustrates three scenarios that arise in practice: an interval that contains zero (inconclusive), an interval entirely above zero (evidence µ1 > µ2), and an interval entirely below zero (evidence µ1 < µ2).

Scenario A straddles zero, so the data do not provide convincing evidence of a difference. Scenario B lies entirely to the right of zero, supporting the claim that µ₁ is greater than µ₂. Scenario C lies entirely to the left, supporting the claim that µ₁ is less than µ₂. The hollow dot on each interval marks the point estimate x̄₁ − x̄₂.

The critical question is always whether the value zero is inside or outside the interval. Zero represents the null claim that the two populations share the same mean. When the interval excludes zero, every plausible value of µ₁ − µ₂ is either strictly positive or strictly negative, providing convincing evidence at the given confidence level that a real difference exists. When zero is captured, we cannot rule out the possibility that any observed sample difference is simply the product of chance.

Mathematical Framework

The two-sample t-interval for µ1 − µ2 has the familiar structure of "point estimate ± margin of error." The formulas below show how the interval is constructed and how each component contributes to the final result.

POINT ESTIMATE
x̄₁ − x̄₂
x̄₁ and x̄₂ are the sample means from populations 1 and 2, respectively. This quantity estimates the true difference µ₁ − µ₂.
STANDARD ERROR
SE = √(s₁² / n₁ + s₂² / n₂)
s₁ and s₂ are the sample standard deviations; n₁ and n₂ are the sample sizes. Because the samples are independent, the variances add under the square root.
CONFIDENCE INTERVAL
(x̄₁ − x̄₂) ± t* × √(s₁² / n₁ + s₂² / n₂)
t* is the critical value from the t-distribution for the chosen confidence level C. Degrees of freedom are computed using the Welch–Satterthwaite approximation (or by calculator). The interval gives all plausible values for µ₁ − µ₂ at confidence level C.
WELCH–SATTERTHWAITE DEGREES OF FREEDOM
df = (s₁²/n₁ + s₂²/n₂)² / [ (s₁²/n₁)²/(n₁−1) + (s₂²/n₂)²/(n₂−1) ]
This approximation yields a non-integer df, which is typically truncated or handled by technology. On the AP exam, a calculator or table provides the critical value; you do not need to memorize this formula but should know it exists.
📝 Exam Tip
On the AP Statistics exam, you are expected to state, check, and verify the Random, Independent (10%), and Normal/Large Sample conditions before constructing the interval. Failure to address conditions is one of the most common point deductions on FRQs.

Decision Rules & Interpretation

Once the confidence interval has been constructed, the interpretive step is what earns full credit on the AP exam. The decision rule is straightforward, but the language of justification must be precise. The following table codifies the three cases and the corresponding claim each supports.

Decision rules for a confidence interval for µ₁ − µ₂
Position of Interval Relative to 0ConclusionJustification Template
Entire interval is positive (both endpoints > 0)Convincing evidence that µ₁ > µ₂"Because the interval (L, U) lies entirely above 0, we are C% confident that µ₁ − µ₂ > 0, meaning µ₁ is greater than µ₂."
Entire interval is negative (both endpoints < 0)Convincing evidence that µ₁ < µ₂"Because the interval (L, U) lies entirely below 0, we are C% confident that µ₁ − µ₂ < 0, meaning µ₁ is less than µ₂."
Interval contains 0 (one endpoint negative, one positive)No convincing evidence of a difference"Because the interval (L, U) contains 0, it is plausible that µ₁ − µ₂ = 0, so there is not convincing evidence that the means differ."
This flowchart summarizes the decision process. After computing the confidence interval (L, U), check whether zero lies inside. If it does not, determine the sign of the interval to identify which mean is larger.
⚠️ Common Mistake
Students sometimes say "we accept that the means are equal" when the interval contains zero. This is incorrect. Containing zero means we fail to find convincing evidence of a difference—absence of evidence is not evidence of absence. Always frame the conclusion in terms of lacking evidence, not accepting equality.

Worked Example

A nutritionist wants to compare the mean daily caloric intake of adults in City A versus City B. She selects independent random samples of 35 adults from each city and records their daily caloric intake. The sample data are as follows: City A has x̄1 = 2180 kcal, s1 = 320 kcal, n1 = 35. City B has x̄2 = 2040 kcal, s2 = 280 kcal, n2 = 35. Construct a 95% confidence interval for µ1 − µ2 and determine whether there is convincing evidence that the mean caloric intakes differ.

Two-Sample t-Interval for µ₁ − µ₂
1
Step 1 — Define the ParameterLet µ₁ = the true mean daily caloric intake for all adults in City A, and µ₂ = the true mean daily caloric intake for all adults in City B. We wish to estimate µ₁ − µ₂.
2
Step 2 — Check ConditionsRandom: Both samples are independent random samples from their respective cities. Independent (10% condition): It is reasonable to assume there are more than 350 adults in each city, so each sample is less than 10% of its population. The two samples are also independent of each other. Normal/Large Sample: Both n₁ = 35 ≥ 30 and n₂ = 35 ≥ 30, so by the Central Limit Theorem, the sampling distribution of x̄₁ − x̄₂ is approximately normal.
3
Step 3 — Calculate the Point Estimatex̄₁ − x̄₂ = 2180 − 2040 = 140 kcal.
Point estimate = 140 kcal
4
Step 4 — Compute the Standard ErrorSE = √(s₁²/n₁ + s₂²/n₂) = √(320²/35 + 280²/35) = √(102400/35 + 78400/35) = √(2925.71 + 2240.00) = √5165.71 ≈ 71.87 kcal.
SE ≈ 71.87 kcal
5
Step 5 — Find t* and Compute the IntervalUsing technology (or the Welch–Satterthwaite formula), df ≈ 66.1. For a 95% confidence interval, t* ≈ 1.997. The margin of error is ME = 1.997 × 71.87 ≈ 143.5 kcal. The confidence interval is 140 ± 143.5, which gives (−3.5, 283.5).
95% CI: (−3.5, 283.5)
6
Step 6 — Interpret and JustifyWe are 95% confident that the true difference in mean daily caloric intake (City A − City B) is between −3.5 kcal and 283.5 kcal. Because this interval contains 0, there is not convincing evidence at the 95% confidence level that the true mean daily caloric intake differs between adults in City A and adults in City B. It is plausible that the two population means are equal.

Confidence Intervals vs. Hypothesis Tests

Students often wonder about the relationship between a confidence interval for µ₁ − µ₂ and a two-sample t-test. Both procedures use the same underlying sampling distribution and conditions, but they answer slightly different questions. Understanding their connection deepens your ability to justify claims on the AP exam, where you may be asked to draw conclusions from either output.

Comparing confidence intervals and hypothesis tests for two means
FeatureConfidence IntervalHypothesis Test
OutputA range of plausible values for µ₁ − µ₂A p-value measuring evidence against H₀: µ₁ − µ₂ = 0
Decision criterionDoes the interval contain 0?Is the p-value ≤ α?
Effect size informationYes — the interval shows plausible magnitudesNot directly — the p-value does not indicate magnitude
ConsistencyA two-sided C% CI excludes 0 ⟺ the two-sided test rejects H₀ at α = 1 − CA two-sided test at α rejects ⟺ the (1 − α)×100% CI excludes 0
AdvantageCommunicates both direction and practical significanceFamiliar reject/fail-to-reject framework; useful for one-sided alternatives
KEY TAKEAWAY
A confidence interval is like reading a thermometer—it tells you the range and magnitude of the difference, not just whether the temperature crossed a single threshold. A hypothesis test only tells you whether the reading exceeded a critical mark (α). In research and on the AP exam, the interval provides richer information because it simultaneously addresses both statistical significance (does the interval exclude zero?) and practical significance (how large could the difference plausibly be?).

Connection to Advanced Topics

The two-sample t-interval is a gateway to several more sophisticated techniques encountered in college-level and graduate statistics courses. Understanding the logic of "does the interval capture the null value?" transfers directly to each of these extensions.

How the two-sample CI concept extends beyond AP Statistics
AP Statistics (This Lesson)Advanced Extension
Two independent samples, each with one quantitative variablePaired t-interval (matched pairs), where the difference is computed within each pair before building a one-sample interval on the differences
Compare two groups' meansANOVA and simultaneous confidence intervals (e.g., Tukey HSD) compare three or more group means while controlling the family-wise error rate
Welch t-interval with approximate dfBootstrap confidence intervals that make no distributional assumption; resample with replacement to estimate the sampling distribution directly
Check whether 0 is in the interval (binary decision)Equivalence testing (TOST procedure): reverse the logic and show the difference is small enough to be practically negligible

The interpretive skill you build here—checking whether a null value falls inside or outside an interval and articulating what that implies—remains the universal reasoning pattern across all of these methods. Whether you are comparing means, proportions, regression slopes, or any other parameter, the question is always: does the interval for the relevant difference include the value specified by the null claim? Mastering this logic now positions you well for future coursework in mathematical statistics, experimental design, and applied data science.

Practice Problems

1
A 95% confidence interval for µ₁ − µ₂ is (−4.2, 12.8). Which of the following is the best conclusion?
2
Two independent random samples yield: x̄₁ = 50, s₁ = 8, n₁ = 40, and x̄₂ = 45, s₂ = 10, n₂ = 50. The standard error of x̄₁ − x̄₂ is closest to which value?
3
A researcher obtains a 90% confidence interval for µ₁ − µ₂ of (2.3, 8.7). She then constructs a 99% confidence interval using the same data. Which of the following best describes the 99% interval and its implications?
PROBLEM 4APPLIED
An agricultural scientist randomly assigns 25 plots to Fertilizer A and 25 plots to Fertilizer B, measuring crop yield (bushels per acre). She obtains: x̄_A = 142, s_A = 18, x̄_B = 128, s_B = 22. Construct a 95% confidence interval for µ_A − µ_B and use it to determine whether there is convincing evidence that Fertilizer A produces a higher mean yield than Fertilizer B. State the conditions, show your work, and write a conclusion in context.
PROBLEM 5CRITICAL THINKING
A 95% confidence interval for µ₁ − µ₂ is (0.5, 6.3), based on independent random samples from two populations. (a) A classmate claims, "Since the interval does not contain 0, we have proven that µ₁ ≠ µ₂." Explain what is wrong with this statement. (b) Another classmate says, "A 99% confidence interval from the same data would also exclude 0, so we'd have even stronger evidence." Evaluate this claim. (c) Suppose both sample sizes were quadrupled while the sample means and standard deviations remained the same. Describe how the 95% confidence interval would change and what effect this would have on the strength of evidence.

Lesson Summary

A two-sample t-interval for µ₁ − µ₂ is constructed as (x̄₁ − x̄₂) ± t* × SE, where SE = √(s₁²/n₁ + s₂²/n₂). Before computing this interval, you must verify the Random, Independent, and Normal/Large Sample conditions. The degrees of freedom are computed via the Welch–Satterthwaite approximation and used to find the critical value t*.

To justify a claim, check whether zero lies inside or outside the interval. If the entire interval is above zero, there is convincing evidence that µ₁ > µ₂. If entirely below zero, there is convincing evidence that µ₁ < µ₂. If the interval contains zero, there is not convincing evidence of a difference—but this does not prove the means are equal. Always frame conclusions in context, reference the confidence level, and connect the interval's position to your inferential claim.

Varsity Tutors • AP Statistics • Justifying a Claim About the Difference of Two Means Based on a Confidence Interval