01 / 21

Inferences & Claims
From Statistics

Master how to evaluate survey design, judge statistical claims, and draw valid conclusions from data on the PSAT.

PSAT Math

What Are Statistical Inferences?

A statistical inference is a conclusion drawn about a population based on data collected from a sample. On the PSAT, you will decide whether a claim is supported by the study described.

Population
The entire group you want to learn about (e.g., all students at a school).
Sample
A subset of the population that is actually measured or surveyed.
Inference
The conclusion you extend from the sample back to the population.

Why Random Sampling Matters

For a conclusion about a population to be valid, the sample must be representative. The gold standard is a random sample, where every member of the population has an equal chance of being selected.

Population Random Sample

Sources of Bias

Bias occurs when the sample does not accurately represent the population. This makes any inference unreliable. The PSAT tests whether you can spot biased study designs.

Selection Bias
The method of choosing participants systematically excludes part of the population (e.g., surveying only volunteers).
Response Bias
Participants give inaccurate answers due to question wording, social pressure, or misunderstanding.
Undercoverage
Some groups in the population have little or no chance of being sampled (e.g., online-only survey misses those without internet).

Experiments vs. Observational Studies

The PSAT frequently asks: "Can this study establish causation?" The answer depends entirely on the study type.

Experiment
Researcher randomly assigns subjects to treatment and control groups. Can establish cause-and-effect.
Observational Study
Researcher observes without intervening. Can show association, but cannot prove causation.

The Two Core Rules of Inference

Rule 1: Generalization Random sample → Generalize to population ✓ Valid inference about population Rule 2: Causation Random assignment → Cause-and-effect claim ✓ Valid causal conclusion Both Together Random sample + Random assignment → Causal claim about the entire population

Understanding Margin of Error

The margin of error tells you how much the sample result might differ from the true population value. A survey result of 60% with a margin of error of \(\pm 4\%\) means the true value is likely between 56% and 64%.

56% 60% 64% ± 4% margin of error Sample estimate

Association vs. Causation

Association Causation
Study type Observational study Controlled experiment
Assignment No random assignment Random assignment
Language "linked to," "correlated with" "caused by," "due to"
Confounders May be present Controlled for
PSAT answer "is associated with" "is likely caused by"

How to Evaluate a Claim

1
Identify the population. Who is the study trying to learn about?
2
Examine the sample. Was it randomly selected from that population?
3
Check the design. Is it an experiment (random assignment) or observational study?
4
Match the conclusion. Does the claim stay within what the study can support?
5
Watch for over-claims. Reject answers that generalize too broadly or claim causation without an experiment.

Example 1: School Survey

1
Population: All 2,000 students at the high school.
2
Sample: 200 students, randomly selected → representative.
3
Design: Observational (no treatment assigned).
4
Valid claim: "Students at this school study about 8.5 hours per week on average."

Example 2: Fertilizer Experiment

✓ Can say
Fertilizer A caused more growth than B for these plants (random assignment → causation).
✕ Cannot say
Fertilizer A causes more growth for all plants everywhere (no random sample from a larger population).

Example 3: Margin of Error

Confidence Intervals Poll 1 (n = 500) 62% | 50% | 55% | 60% | 65% | 70% Poll 2 (n = 125) 58%

Scope of Inference Matrix

RANDOM ASSIGNMENT? No Yes RANDOM SAMPLE? No Yes No generalization No causation Only describes the sample itself No generalization ✓ Causation Cause-and-effect for subjects in the study ✓ Generalization No causation Association claim about the population ✓ Generalization ✓ Causation Causal claim about the entire population

Sample Size & Variability

The PSAT may ask how sample size affects the reliability of results. Larger samples reduce random variability and produce more consistent estimates.

Sample Size Variability 25 100 250 500 1000 High variability Low variability

Common Mistakes

✕ Claiming Causation
Saying X "causes" Y from an observational study. Without random assignment, you can only claim association.
✕ Over-Generalizing
Extending results to a larger group than the population the sample was drawn from (e.g., one school → all schools).
✕ Ignoring Sample Method
Treating a convenience sample (volunteers, one class period) the same as a random sample.

Summary Checklist

Question to Ask If Yes If No
Random sample? Generalize to population Only about the sample
Random assignment? Can claim causation Association only
Large sample? Smaller margin of error Larger margin of error
Intervals overlap? No significant difference Plausible difference
Volunteer sample? Likely biased Less bias concern

Question 1 of 5

Which conclusion is best supported by this study?

Question 2 of 5

Which statement is best supported?

Question 3 of 5

A town puts up a sign-up sheet at the library asking residents to volunteer for a survey about park usage. 150 people sign up. Which problem most threatens the validity of generalizing the results to all town residents?

Question 4 of 5

Survey A polls 400 randomly selected voters and finds 52% support a ballot measure (\(\pm 4\%\)). Survey B polls 1,600 randomly selected voters and finds 52% support (\(\pm 2\%\)). What is the most accurate comparison?

Question 5 of 5

Which conclusion is most supported?