Statistical Conclusions — I can communicate conclusions with appropriate uncertainty language (evidence suggests, likely) at my level. - Grade 11 Math

SECTION 1

Historical Context & Motivation

Humans have always drawn conclusions from observations, but for centuries those conclusions were stated as absolute truths — even when the evidence was incomplete. The rise of probability theory and statistical inference gradually taught scientists and mathematicians that uncertainty is not a weakness — it is an honest acknowledgment of reality. Today, every credible scientific study, medical trial, and opinion poll communicates its findings with language that signals how confident the researchers actually are.

1654 • The Birth of Probability

Blaise Pascal and Pierre de Fermat exchanged letters about gambling problems, laying the mathematical foundation for reasoning about uncertain events.

1763 • Bayes' Theorem Published

Thomas Bayes' posthumous paper introduced a formal way to update beliefs based on new evidence, emphasizing that conclusions should change as data accumulate.

1925 • Fisher's Statistical Methods

Ronald Fisher formalized hypothesis testing and p-values, giving researchers a systematic language for describing the strength of evidence behind their conclusions.

2016 • ASA Statement on P-Values

The American Statistical Association issued guidelines urging researchers to avoid claiming certainty and instead use phrases like 'the evidence suggests' — underscoring the importance of uncertainty language.

This historical arc raises a critical question for anyone working with data: How do we communicate what the data tell us without overstating or understating what we actually know? That is exactly what this lesson addresses — learning to write conclusions that are honest, precise, and appropriately uncertain.

SECTION 2

Core Principles of Uncertainty Language

When you analyze data and draw a conclusion, your job is not simply to announce a result. You must also signal how strong the evidence is. This is where uncertainty language comes in — a set of carefully chosen phrases that tell your reader exactly how confident you are and why. The principles below form the foundation of this skill.

Evidence ≠ Proof

Statistical studies provide evidence for or against a claim, but they rarely prove anything with 100% certainty. Use words like 'suggests' or 'indicates' instead of 'proves.'

Strength of Evidence Varies

Some results are very unlikely to be due to chance (strong evidence), while others could easily have occurred randomly (weak evidence). Your language should match the strength.

Context Matters

A conclusion must reference the specific population, sample, and conditions of the study. Avoid sweeping generalizations that go beyond what your data can support.

Correlation ≠ Causation

Observational studies can show that two variables are associated, but only controlled experiments can establish cause and effect. Choose your verbs accordingly.

Transparency Builds Trust

Acknowledging limitations — sample size, possible bias, margin of error — makes your conclusion more credible, not less. Readers trust honest communication.

✦

KEY TAKEAWAY

Think of uncertainty language like a weather forecast. A meteorologist doesn't say 'It will rain tomorrow' — she says 'There is a 70% chance of rain.' By stating the level of confidence, she respects both the data and the listener's need to make informed decisions. Statistical conclusions work the same way: you report what the evidence shows and how sure you are, so your audience can judge for themselves.

SECTION 3

Visual Explanation — The Uncertainty Spectrum

One of the best ways to understand uncertainty language is to visualize it on a spectrum — from no evidence at all to very strong evidence. The diagram below maps common statistical phrases to their position on this spectrum and connects each phrase to the type of study design that typically supports it.

The spectrum shows how the strength of statistical evidence maps to the language you should use. On the left, weak evidence calls for cautious phrases like 'it is possible.' On the right, very strong evidence permits bolder language like 'strong evidence shows.' The approximate p-value ranges provide a rough guide, but always consider sample size and context as well.

Notice that even at the far right of the spectrum, the language never says 'this proves.' That is because statistical tests tell us how surprising the data would be if no real effect existed; they do not deliver absolute certainty. Your word choices should always reflect this fundamental limitation. A p-value near 0.01 is impressive, but it still leaves room — however small — for chance to have played a role.

SECTION 4

Mathematical Framework — Evidence and P-Values

Uncertainty language is rooted in the mathematics of hypothesis testing. When you run a statistical test, the output is often a p-value — a number that quantifies how surprising your observed result would be if there were truly no effect. Understanding a few key formulas helps you know which phrases to choose.

Z-TEST STATISTIC

z = (x̄ − μ₀) / (σ / √n)

x̄ = sample mean, μ₀ = hypothesized population mean, σ = population standard deviation, n = sample size. A larger |z| means your sample mean is farther from the hypothesized value, yielding a smaller p-value and stronger evidence.

CONFIDENCE INTERVAL

x̄ ± z* × (σ / √n)

z* = critical value for desired confidence level (e.g., 1.96 for 95%). The interval gives a range of plausible values for the true population parameter. If the interval does not contain the null value, you have statistically significant evidence.

MARGIN OF ERROR

E = z* × (σ / √n)

The margin of error tells you how much the sample statistic could differ from the true parameter. A large margin of error means more uncertainty, requiring more cautious language in your conclusion.

The connection between these formulas and your word choices is direct. A small p-value (below the significance level α, often 0.05) allows you to use phrases like 'the evidence strongly suggests.' A large margin of error or a wide confidence interval requires more hedging — phrases like 'it is possible' or 'the data are consistent with.' Always let the numbers guide your words.

SECTION 5

Detailed Phrase Guide — Matching Words to Evidence

Choosing the right phrase is a skill that takes practice. The table below organizes common uncertainty phrases by the strength of evidence they imply, along with the situations where each phrase is most appropriate. Think of this as a toolbox: the stronger your statistical evidence, the more confident the tool you can reach for.

This flowchart shows the two-step decision process for choosing uncertainty language. First, determine whether the study was experimental (randomized) or observational — this decides if you can use causal language. Second, compare the p-value to your significance level α to decide how strong your language can be.

Strength	Phrases to Use	When Appropriate
Very Cautious	"It is possible that…" · "The data are consistent with…" · "We cannot rule out…"	Large p-value (> 0.10), small sample, or wide confidence interval
Moderate	"Evidence suggests…" · "There appears to be…" · "It seems likely that…"	p-value near 0.05, reasonable sample size, moderate effect size
Confident	"The data strongly suggest…" · "It is likely that…" · "The results indicate…"	p-value < 0.05, adequate sample, narrow confidence interval
Very Confident	"Strong evidence shows…" · "We are highly confident…" · "There is convincing evidence…"	p-value < 0.01, large sample, replicated results
⚠ NEVER Use	"This proves…" · "We are 100% certain…" · "It is a fact that…"	Never appropriate — statistical evidence cannot yield absolute proof

A guide to matching phrase strength with statistical evidence

⚠

Watch Your Verbs!

In observational studies, avoid causal verbs like 'causes,' 'leads to,' or 'produces.' Instead, use relational verbs like 'is associated with,' 'is related to,' or 'tends to accompany.' Save causal language for randomized controlled experiments where confounding variables have been managed.

SECTION 6

Worked Example — Writing a Statistical Conclusion

A school nutritionist wants to know whether students who eat breakfast score higher on morning exams. She collects data from 80 students — 45 who regularly eat breakfast and 35 who do not. This is an observational study (she did not randomly assign students to eat or skip breakfast). After running a two-sample z-test at a significance level of α = 0.05, she obtains a test statistic of z = 2.31 and a p-value of 0.021. The 95% confidence interval for the difference in means (breakfast group minus no-breakfast group) is (1.2, 8.4) points. Let's construct a proper conclusion.

Writing a Conclusion with Appropriate Uncertainty Language

1
Step 1 — Identify the Study Design

Because the nutritionist observed students' existing habits rather than randomly assigning them to groups, this is an observational study. This means we cannot claim causation — we can only discuss association.

Observational → Use association language only
2
Step 2 — Compare p-value to α

The p-value is 0.021, which is less than α = 0.05. This means the result is statistically significant — we reject the null hypothesis that there is no difference between the two groups.

p = 0.021 < α = 0.05 → Statistically significant
3
Step 3 — Assess the Confidence Interval

The 95% confidence interval for the difference is (1.2, 8.4) points. Because this interval does not contain zero, it supports the conclusion that there is a real positive difference. The width of the interval (7.2 points) suggests moderate precision.

CI = (1.2, 8.4) — does not contain 0 → supports significance
4
Step 4 — Choose Appropriate Phrases

Because the result is significant (p < 0.05) but the study is observational, we should use moderately confident association language. Good choices: 'evidence suggests,' 'is associated with,' 'the data indicate.' We should avoid: 'eating breakfast causes,' 'proves,' 'is certain.'

"Evidence suggests" + association verb
5
Step 5 — Write the Conclusion

Putting it all together, here is a well-written statistical conclusion:

"Based on a sample of 80 students, the evidence suggests that eating breakfast is associated with higher morning exam scores. Students who ate breakfast scored, on average, between 1.2 and 8.4 points higher than those who did not (95% CI). Because this was an observational study, it is possible that other factors, such as sleep habits or motivation, contributed to the difference."

💡

Notice the Structure

A strong statistical conclusion includes four elements: (1) the sample and context, (2) the direction and size of the effect, (3) the level of confidence, and (4) any limitations. Practice weaving all four into one or two clear sentences.

SECTION 7

Common Mistakes & How to Avoid Them

Even after learning the principles, students often fall into predictable traps when writing statistical conclusions. The table below contrasts poor phrasing with improved alternatives so you can spot and correct these errors in your own work.

Mistake	Poor Phrasing	Better Phrasing
Claiming proof	"This proves that exercise improves mood."	"The evidence suggests that exercise is associated with improved mood."
Causation from observation	"Drinking coffee causes students to get higher grades."	"Students who drink coffee tend to have higher grades; however, this observational study cannot establish causation."
Ignoring sample size	"Americans prefer Brand A" (based on 12 people surveyed).	"In a small sample of 12 respondents, Brand A was preferred; larger studies are needed to generalize."
Accepting H₀	"We proved there is no difference between the two groups."	"The data do not provide sufficient evidence to conclude that a difference exists between the groups."
Over-generalizing	"All teenagers prefer texting to calling."	"Among the 200 teenagers surveyed in this study, texting was strongly preferred over calling."

Common statistical conclusion mistakes with corrections

⭐

THE GOLDEN RULE

Imagine you are a lawyer in court. You would never tell the jury 'my client is definitely innocent' without rock-solid evidence. Instead, you present the facts and let the jury decide. A statistical conclusion works the same way — you present the evidence clearly, state how strong it is, acknowledge what you don't know, and let the reader reach an informed judgment.

SECTION 8

Connection to Advanced Statistical Reasoning

The uncertainty language you are learning now is the gateway to more sophisticated statistical communication used in college-level courses, professional research, and data science. As you advance, the concepts deepen but the core principle remains the same: always match your confidence to your evidence.

What You Learn Now	Where It Leads
Using phrases like 'evidence suggests' based on p-values	Reporting effect sizes, confidence intervals, and Bayesian credible intervals in research papers
Distinguishing observational from experimental studies	Designing randomized controlled trials (RCTs) and understanding causal inference frameworks
Noting sample size limitations	Power analysis — calculating how large a sample you need before collecting data
Acknowledging possible confounders	Using regression models, propensity score matching, and other techniques to control for confounders
Writing one-paragraph conclusions for class	Writing Discussion sections in published journal articles with nuanced interpretation of results

How this lesson's skills connect to advanced statistics

If you plan to study AP Statistics, data science, psychology, biology, or any research-oriented field, the habits you build here — choosing words carefully, referencing evidence, and acknowledging limitations — will serve as the foundation of your scientific communication. The more advanced the analysis, the more important precise uncertainty language becomes.

SECTION 9

Practice Problems

Question 1: CONCEPTUAL

A classmate writes: 'Our survey of 50 students proves that teenagers prefer Instagram over TikTok.' Identify at least two problems with this statement and rewrite it using appropriate uncertainty language.

Show answer

There are two main problems. First, the word 'proves' is too strong — a survey provides evidence, not proof. Second, a sample of 50 students from one school cannot represent all teenagers. A better version: 'Based on a survey of 50 students at our school, the data suggest that Instagram may be preferred over TikTok in this population; however, this small, non-random sample limits the generalizability of the finding.' This version hedges appropriately and identifies the limitation.

Question 2: BASIC CALCULATION

A researcher tests whether a new fertilizer increases tomato yield. She obtains a p-value of 0.038 using α = 0.05 in a randomized experiment. Is the result statistically significant? Write one sentence that communicates this finding with appropriate uncertainty language.

Show answer

Yes, the result is statistically significant because 0.038 < 0.05. Because this was a randomized experiment, causal language is permitted. An appropriate conclusion sentence: 'The evidence suggests that the new fertilizer likely increases tomato yield compared to the control (p = 0.038).' The phrase 'evidence suggests' and 'likely' correctly convey moderate confidence, and the causal wording is acceptable because the study used random assignment.

Question 3: INTERMEDIATE

An observational study of 300 adults finds that those who sleep more than 7 hours per night have lower blood pressure. The 95% confidence interval for the difference in mean systolic blood pressure is (−6.8, −1.2) mmHg and the p-value is 0.006. Write a full statistical conclusion that includes the study design, direction and size of the effect, confidence level, and at least one limitation.

Show answer

A strong conclusion would be: 'In this observational study of 300 adults, strong evidence suggests that sleeping more than 7 hours per night is associated with lower systolic blood pressure. Those who slept more had blood pressure that was, on average, between 1.2 and 6.8 mmHg lower (95% CI). However, because this was not a randomized experiment, confounding factors such as diet, exercise, or stress levels may account for part of the observed difference.' This answer earns full marks because it uses 'strong evidence suggests' (appropriate for p = 0.006), avoids causal language due to the observational design, reports the confidence interval, and names a plausible confounder.

Question 4: APPLIED

A city's transportation department conducts a randomized experiment: they install speed bumps on 20 randomly selected residential streets and leave 20 similar streets without speed bumps. After six months, the average number of speeding violations on streets with speed bumps is 3.1 per week, compared to 5.8 per week on streets without. The p-value is 0.002 and the 95% CI for the difference is (−4.2, −1.2) violations per week. Write a conclusion suitable for a report to the city council.

Show answer

A suitable conclusion: 'There is strong evidence that installing speed bumps reduces speeding violations on residential streets. In our randomized experiment of 40 streets over six months, streets with speed bumps averaged 2.7 fewer speeding violations per week compared to control streets (95% CI: 1.2 to 4.2 fewer violations, p = 0.002). Because streets were randomly assigned to treatment and control groups, we are confident that the speed bumps themselves — rather than other factors — are likely responsible for the reduction. The council should note that these results apply to streets similar to those studied, and long-term effects may differ.' This conclusion uses strong causal language ('reduces,' 'responsible for') because the study was a true randomized experiment with p = 0.002, includes quantitative results, and notes scope limitations.

Question 5: CRITICAL THINKING

Two studies examine whether listening to music while studying improves test scores. Study A is a randomized experiment with 200 participants and finds p = 0.12. Study B is an observational study with 500 participants and finds p = 0.003. A news headline claims: 'Science confirms: music boosts your grades!' Critique this headline by writing a paragraph that explains what each study actually shows and why the headline is misleading.

Show answer

The headline is misleading in multiple ways. Study A, the randomized experiment, did not find statistically significant results (p = 0.12 > 0.05), meaning the data do not provide sufficient evidence that music improves test scores in a controlled setting. Study B found a highly significant association (p = 0.003) with a large sample, but because it was observational, it cannot establish causation — students who choose to listen to music may differ from those who do not in ways that also affect grades (e.g., study habits, subject interest). A more accurate summary would be: 'An observational study of 500 students found strong evidence that listening to music while studying is associated with higher test scores; however, a randomized experiment of 200 students did not find a statistically significant effect. More research is needed before drawing firm conclusions.' This critique demonstrates that study design and statistical significance must both be considered, and that 'confirms' is never appropriate language for a single round of studies.

SUMMARY

Lesson Summary

Summary

Communicating statistical conclusions with appropriate uncertainty language is one of the most important skills in statistics. You learned that statistical evidence supports but never proves a claim, that the strength of your language should match the strength of your evidence (as measured by p-values, confidence intervals, and sample size), and that study design determines whether you can use causal language — only randomized experiments support causal claims, while observational studies are limited to association.

Key phrases to remember include "evidence suggests" for moderate findings, "it is likely that" for confident results, and "strong evidence shows" for very robust findings. A complete conclusion should reference the sample and context, the direction and size of the effect, the level of confidence, and any limitations or possible confounders. Mastering this skill makes you a more trustworthy communicator and prepares you for advanced work in any data-driven field.