AP Statistics • Probability, Random Variables, and Probability Distributions

Introduction to Probability

Quantifying uncertainty transforms intuition into a rigorous mathematical framework for statistical inference.

A scatter plot with data columns and a percentage symbol.
Inside this lesson 10 sections 5 questions 9 figures

SECTION 1

Historical Context & Motivation

Long before statisticians formalized the rules of chance, gamblers and merchants grappled with uncertainty in their daily lives. The mathematical study of probability arose from a deceptively simple question: how should two players divide the stakes of an unfinished game of chance? This question, posed to Blaise Pascal by the Chevalier de Méré in 1654, ignited a correspondence between Pascal and Pierre de Fermat that laid the intellectual groundwork for an entire branch of mathematics. Over the following centuries, probability evolved from a tool for analyzing games of dice into the bedrock upon which modern statistical inference, actuarial science, quantum mechanics, and machine learning all rest.

1654 • The Pascal–Fermat Correspondence

Blaise Pascal and Pierre de Fermat exchange letters solving the "Problem of Points," establishing the first systematic treatment of probability through combinatorial reasoning.

1713 • Bernoulli's Ars Conjectandi

Jacob Bernoulli posthumously publishes his treatise containing the Law of Large Numbers, demonstrating that relative frequencies converge to theoretical probabilities as the number of trials grows.

1812 • Laplace's Théorie Analytique

Pierre-Simon Laplace synthesizes probability theory into a comprehensive analytical framework, formalizing the classical definition of probability and introducing generating functions.

1933 • Kolmogorov's Axioms

Andrey Kolmogorov publishes his axiomatic foundation for probability using measure theory, unifying competing approaches and establishing the modern mathematical framework used today.

In the context of AP Statistics, probability serves as the bridge between descriptive statistics—summarizing data we have already observed—and inferential statistics—drawing conclusions about populations from samples. Without a formal probability framework, concepts such as confidence intervals, p-values, and hypothesis tests would lack any rigorous justification. The central question this lesson addresses is: How do we assign meaningful numerical values to uncertain outcomes, and what rules govern how those values combine?

SECTION 2

Core Principles & Definitions

Probability quantifies how likely an event is to occur, assigning a number between 0 and 1 (inclusive) to every possible outcome of a random process. Before we can compute probabilities, we need precise language. A random process (or experiment) is any repeatable procedure whose outcome is uncertain—rolling a die, drawing a card, or selecting a person at random from a population. The sample space S is the set of all possible outcomes of that process. An event is any subset of the sample space, ranging from a single outcome to the entire sample space itself.

1

Sample Space (S)

The complete set of all possible outcomes. For a standard die, S = {1, 2, 3, 4, 5, 6}. Every probability calculation begins with clearly defining S.
2

Event

Any subset of S. The event "rolling an even number" is {2, 4, 6}. Events can be combined using union (or), intersection (and), and complement (not).
3

Probability Assignment

Each outcome is assigned a probability between 0 and 1. The sum of probabilities across all outcomes in S must equal exactly 1—certainty is fully distributed.
4

Complement Rule

The probability that event A does not occur equals 1 − P(A). This simple rule is a powerful shortcut when computing P(A) directly is complex.
5

Law of Large Numbers

As the number of trials increases, the relative frequency of an event converges to its true probability. This connects long-run behavior to theoretical probability.
✦

KEY TAKEAWAY

Think of the sample space as a budget of certainty equal to 1.00. Every outcome "spends" some fraction of that budget, and when you add up every outcome's share, the account must balance to exactly 1. An event's probability is simply the total share of the budget claimed by the outcomes in that event. This budgetary constraint—Kolmogorov's first and second axioms—prevents contradictions and ensures all probability calculations remain internally consistent.

SECTION 3

Visual Explanation — Sample Space & Events

Sample Space S — Rolling Two Dice36 equally likely outcomesSDie 2Die 1123456123456(1,1)(2,1)(3,1)(4,1)(5,1)(6,1)(1,2)(2,2)(3,2)(4,2)(5,2)(6,2)(1,3)(2,3)(3,3)(4,3)(5,3)(6,3)(1,4)(2,4)(3,4)(4,4)(5,4)(6,4)(1,5)(2,5)(3,5)(4,5)(5,5)(6,5)(1,6)(2,6)(3,6)(4,6)(5,6)(6,6)Event A: Sum = 7 (6 outcomes)
The grid displays all 36 equally likely outcomes when rolling two fair dice. The highlighted cells represent Event A: the sum equals 7. Because 6 out of 36 outcomes satisfy this condition, P(A) = 6/36 = 1/6.

The diagram above illustrates a fundamental approach to probability: enumerate the sample space, identify the outcomes belonging to the event of interest, and compute the ratio. When rolling two fair dice, the sample space contains 36 equally likely outcomes arranged in a grid. Event A—"the sum equals 7"—corresponds to six outcomes along the anti-diagonal: (1, 6), (2, 5), (3, 4), (4, 3), (5, 2), and (6, 1). Because the outcomes are equally likely, we apply the classical probability formula: P(A) = (number of outcomes in A) ÷ (total number of outcomes in S) = 6/36 = 1/6 ≈ 0.167. Notice that 7 is the most probable sum when rolling two dice—no other sum has as many favorable outcomes.

SECTION 4

Mathematical Framework

The modern theory of probability rests on three axioms formalized by Kolmogorov in 1933. From these axioms, every probability rule you will encounter in AP Statistics can be derived. Understanding these foundations ensures that you can reason correctly about even the most counterintuitive probability scenarios.

AXIOM 1 — NON-NEGATIVITY

P(A)≥0foreveryeventAP(A) ≥ 0 for every event A

Every event has a probability that is zero or positive. Negative probabilities are undefined.

AXIOM 2 — NORMALIZATION

P(S)=1P(S) = 1

The probability that some outcome in the sample space occurs is 1 (certainty). This anchors the probability scale.

AXIOM 3 — ADDITIVITY (MUTUALLY EXCLUSIVE EVENTS)

IfA∩B=∅,thenP(A∪B)=P(A)+P(B)If A ∩ B = ∅, then P(A ∪ B) = P(A) + P(B)

If two events cannot occur simultaneously (they are mutually exclusive or disjoint), then the probability of their union equals the sum of their individual probabilities.

GENERAL ADDITION RULE

P(A∪B)=P(A)+P(B)−P(A∩B)P(A ∪ B) = P(A) + P(B) − P(A ∩ B)

When events A and B are not mutually exclusive, their intersection is counted twice; subtracting P(A ∩ B) corrects for this double-counting. This is the version tested most frequently on the AP exam.

COMPLEMENT RULE

P(Ac)=1−P(A)P(Aᶜ) = 1 − P(A)

Aᶜ denotes the complement of A (all outcomes in S not in A). This rule is especially useful when computing P(A) directly is difficult—calculate P(Aᶜ) instead and subtract from 1.

These rules are not independent inventions; each follows logically from the three axioms. The complement rule, for example, follows immediately from Axiom 2 (P(S) = 1) and Axiom 3 (since A and Aᶜ are mutually exclusive and their union is S, we get P(A) + P(Aᶜ) = 1). On the AP exam, you are expected to identify which rule applies, set up the computation correctly, and interpret the result in context.

SECTION 5

Interpretations of Probability

Probability can be interpreted in multiple ways, and understanding these interpretations clarifies when each approach is appropriate. AP Statistics primarily emphasizes two: the classical (equally likely outcomes) interpretation and the relative frequency (empirical) interpretation. A third interpretation—subjective probability—arises when neither equally likely outcomes nor repeated trials are available, such as estimating the probability that a specific bill passes Congress.

Three Interpretations of ProbabilityClassicalEqually likelyoutcomes assumedP(A) = |A| / |S|Example:Fair coin flipP(Heads) = 1/2Best when:Symmetry justifiesequal likelihoodsEmpiricalBased on observedrelative frequenciesP(A) ≈ f(A) / nExample:1000 free throws,820 made → P ≈ 0.82Best when:Large datasets orrepeatable experimentsSubjectivePersonal degreeof beliefP(A) = judgmentExample:"70% chance ofrain tomorrow"Best when:One-time events, norepeatable trials
Three interpretations of probability compared side by side. The classical approach relies on symmetry, the empirical approach relies on data, and the subjective approach relies on informed judgment.

The classical interpretation works beautifully when the physical setup guarantees equally likely outcomes—fair coins, well-shuffled decks, balanced dice. However, most real-world situations lack such symmetry, which is where the empirical interpretation becomes essential. If a manufacturer tests 10,000 circuit boards and finds 47 defective, the empirical probability of a defective board is 47/10,000 = 0.0047. The Law of Large Numbers guarantees that this relative frequency will converge to the true probability as the number of trials grows, providing a powerful link between data and theory. The subjective interpretation, while less commonly tested on the AP exam, is worth noting because it underpins Bayesian statistics and real-world decision-making under unique, non-repeatable circumstances.

SECTION 6

Worked Example — Applying the Addition Rule

A survey of 500 college students found that 220 play a varsity sport, 180 are in a performing-arts group, and 60 do both. If a student is selected at random, what is the probability that the student plays a varsity sport or is in a performing-arts group?

Applying the General Addition Rule

  1. 1

    Step 1 — Define Events and Identify Given Information

    Let A = "plays a varsity sport" and B = "is in a performing-arts group." From the survey data: P(A) = 220/500 = 0.44, P(B) = 180/500 = 0.36, and P(A ∩ B) = 60/500 = 0.12. The events are not mutually exclusive because 60 students participate in both.
  2. 2

    Step 2 — Select the Appropriate Rule

    Because A and B overlap, we cannot simply add P(A) and P(B)—doing so would double-count the 60 students in the intersection. We use the General Addition Rule: P(A ∪ B) = P(A) + P(B) − P(A ∩ B).
  3. 3

    Step 3 — Substitute and Compute

    P(A ∪ B) = 0.44 + 0.36 − 0.12 = 0.68.
    P(A ∪ B) = 0.68
  4. 4

    Step 4 — Interpret in Context

    There is a 0.68 probability (or 68% chance) that a randomly selected student from this college plays a varsity sport, is in a performing-arts group, or participates in both. Context matters on the AP exam—always state what the probability represents in the language of the problem.
  5. 5

    Step 5 — Verify with the Complement

    Students doing neither: 500 − (220 + 180 − 60) = 500 − 340 = 160. So P(neither) = 160/500 = 0.32, and P(A ∪ B) = 1 − 0.32 = 0.68. ✓ The result checks out.

Schematic Venn diagram for 500 students: sport-only 160, both 60, arts-only 120 and neither 160. Union is 340, or 0.68.The 60 students belonging to both groups are subtracted once to avoid double counting, giving 340 of 500 in the union.

Illustrative roster showing shared ID A17 in both lists but only once in their union, alongside B04 and C09.Illustrative roster showing shared ID A17 in both lists but only once in their union, alongside B04 and C09.

SECTION 7

Common Pitfalls & Misconceptions

MisconceptionWhy It's WrongCorrect Reasoning
"The probability of heads after five tails in a row is more than 0.5."This is the Gambler's Fallacy. A fair coin has no memory; each flip is independent of prior outcomes.P(Heads) = 0.5 on every flip, regardless of previous results. Independence means past outcomes do not influence future ones.
"Always add probabilities to find P(A or B)."Simple addition works only for mutually exclusive events. For overlapping events, it double-counts the intersection.Use the General Addition Rule: P(A ∪ B) = P(A) + P(B) − P(A ∩ B). Always check whether events can co-occur.
"If two outcomes aren't the same, they must have equal probability."Equally likely outcomes require a symmetry argument (fair die, well-shuffled deck). Without it, outcomes may have very different probabilities.State why outcomes are equally likely before applying the classical formula. For example, rolling a sum of 2 vs. 7 on two dice are not equally likely.
"A probability of 0.001 means the event will never happen."Low probability does not mean impossible. With enough trials, even rare events occur—this is the basis of quality control and risk management.P(A) = 0 means impossible; anything above 0 can occur. With 10,000 trials, an event with P = 0.001 is expected to occur about 10 times.

Common probability misconceptions and corrections

⚠

KEY TAKEAWAY

On the AP exam, the most heavily penalized errors involve failing to check whether events are mutually exclusive before adding probabilities, or confusing independent events with mutually exclusive events. Two events can be independent (knowing one occurred doesn't change the probability of the other) without being mutually exclusive (they can still co-occur). In fact, if two events each have nonzero probability, they cannot be both independent and mutually exclusive.

SECTION 8

Connection to Conditional Probability & Independence

The probability rules introduced in this lesson form the foundation for two critical extensions: conditional probability and independence. While this lesson focuses on the unconditional probability of events, subsequent lessons explore how the probability of one event changes when we know another event has occurred. These extensions are essential for understanding Bayes' theorem, the multiplication rule for dependent events, and the design of simulation studies.

ConceptThis Lesson (Basics)Next Steps (Advanced)
Event probabilityP(A) computed from sample space or relative frequencyP(A | B) — probability of A given B has occurred
Combining eventsGeneral Addition Rule for P(A ∪ B)General Multiplication Rule: P(A ∩ B) = P(A) × P(B | A)
IndependenceInformal understanding; introduced but not deeply appliedFormal test: P(A ∩ B) = P(A) × P(B) iff A and B are independent
ApplicationsDescribing uncertainty in single experimentsRandom variables, expected value, probability distributions, and statistical inference

How this lesson's concepts connect to advanced probability topics

Looking ahead, the probability rules from this lesson will be applied repeatedly when you study random variables (assigning numerical values to outcomes), probability distributions (the complete mapping from outcomes to probabilities), and the sampling distributions that underpin confidence intervals and significance tests. Mastering these foundational rules now ensures that the transition to inference feels like a natural extension rather than a conceptual leap.

SECTION 9

Practice Problems

Question 1: CONCEPTUAL

Events A and B are mutually exclusive with P(A) = 0.3 and P(B) = 0.5. What is P(A ∪ B)?
  • A. 0.15
  • B. 0.65
  • C. 0.80
  • D. 0.20
  • E. 1.00
Show answer (C)
Because A and B are mutually exclusive, P(A ∩ B) = 0, so P(A ∪ B) = P(A) + P(B) = 0.3 + 0.5 = 0.80. Choice A (0.15) incorrectly multiplies P(A) × P(B), which would apply only if you were computing P(A ∩ B) for independent events. Choice B (0.65) appears to subtract 0.15 from 0.80, applying the General Addition Rule with a nonzero intersection—but mutually exclusive events have no intersection. Choice D (0.20) has no mathematical basis from the given values. Choice E (1.00) would require P(A) + P(B) = 1, which would mean A and B are complements; here 0.3 + 0.5 = 0.8 ≠ 1.

Question 2: BASIC CALCULATION

A bag contains 5 red marbles, 8 blue marbles, and 7 green marbles. If one marble is drawn at random, what is the probability that it is red or green?
  • A. 0.25
  • B. 0.35
  • C. 0.40
  • D. 0.60
  • E. 0.65
Show answer (D)
Total marbles = 5 + 8 + 7 = 20. "Red or green" defines two mutually exclusive events (a marble cannot be both colors simultaneously), so P(Red ∪ Green) = P(Red) + P(Green) = 5/20 + 7/20 = 12/20 = 0.60. Choice A (0.25) equals P(Red) = 5/20 alone. Choice B (0.35) equals P(Green) = 7/20 alone. Choice C (0.40) equals P(Blue) = 8/20, which is the complement event—the probability of drawing the color we are NOT interested in. Choice E (0.65) has no clear derivation from the given values.

Question 3: INTERMEDIATE

In a class of 30 students, 18 study Spanish, 12 study French, and 5 study both languages. What is the probability that a randomly selected student studies at least one of the two languages?
  • A. 5/6
  • B. 1/6
  • C. 1
  • D. 13/30
  • E. 30/30
Show answer (A)
Let S = studies Spanish and F = studies French. Using the General Addition Rule: P(S ∪ F) = P(S) + P(F) − P(S ∩ F) = 18/30 + 12/30 − 5/30 = 25/30 = 5/6 ≈ 0.833. Choice B (1/6) equals the complement—the probability a student studies neither language—obtained via 1 − 5/6 = 1/6 or 5/30. Choice C (1) would mean every student studies at least one language, but 30 − 25 = 5 students study neither. Choice D (13/30) is the result of a common error where a student subtracts P(S ∩ F) from P(S) only, computing 18/30 − 5/30 = 13/30, which gives the probability of studying Spanish but not French rather than at least one language. Choice E (30/30) equals 1 and is incorrect for the same reason as C.

Question 4: APPLIED

4 pts
A quality-control engineer tests electronic components. Historical data show that 4% of components have a defective solder joint, 3% have a defective capacitor, and 1% have both defects. (a) Find the probability that a randomly selected component has at least one of the two defects. (b) Find the probability that a randomly selected component has neither defect. (c) Are the events "defective solder joint" and "defective capacitor" mutually exclusive? Justify your answer. (d) The engineer wants to determine whether the two defects occur independently. Using the given probabilities, determine whether the defects are independent and justify your conclusion.
Show answer
Rubric (4 points): Point 1 (Part a): Let S = defective solder joint and C = defective capacitor. P(S ∪ C) = P(S) + P(C) − P(S ∩ C) = 0.04 + 0.03 − 0.01 = 0.06. There is a 6% probability that a randomly selected component has at least one defect. Point 2 (Part b): Using the complement rule, P(neither defect) = 1 − P(S ∪ C) = 1 − 0.06 = 0.94. There is a 94% probability that a randomly selected component is free of both defects. Point 3 (Part c): The events are NOT mutually exclusive because P(S ∩ C) = 0.01 ≠ 0. This means it is possible for a component to have both a defective solder joint and a defective capacitor simultaneously. If they were mutually exclusive, P(S ∩ C) would equal 0. Point 4 (Part d): If S and C were independent, then P(S ∩ C) would equal P(S) × P(C) = 0.04 × 0.03 = 0.0012. However, the actual P(S ∩ C) = 0.01, which is much larger than 0.0012. Since P(S ∩ C) ≠ P(S) × P(C), the events are NOT independent. The defects co-occur more frequently than they would if they were independent, suggesting a common manufacturing cause.

Question 5: CRITICAL THINKING

4 pts
A research team surveys 1,000 adults and records whether each person exercises regularly (E) and whether each person reports low stress (L). They find P(E) = 0.40, P(L) = 0.55, and P(E ∩ L) = 0.30. (a) Calculate P(E ∪ L) and interpret the result in context. (b) Calculate P(Eᶜ ∩ Lᶜ) and interpret the result in context. (c) A newspaper headline claims: "Exercising guarantees low stress." Using the data, evaluate whether this claim is supported. Provide a probability-based justification. (d) Suppose the research team wanted to determine whether exercise and low stress are independent. State the mathematical condition for independence, test it with the given data, and explain what the result implies about the relationship between exercise and low stress in this sample.
Show answer
Rubric (4 points): Point 1 (Part a): P(E ∪ L) = P(E) + P(L) − P(E ∩ L) = 0.40 + 0.55 − 0.30 = 0.65. There is a 65% probability that a randomly selected adult from this sample either exercises regularly, reports low stress, or does both. Point 2 (Part b): P(Eᶜ ∩ Lᶜ) = P((E ∪ L)ᶜ) = 1 − P(E ∪ L) = 1 − 0.65 = 0.35. There is a 35% probability that a randomly selected adult neither exercises regularly nor reports low stress. Point 3 (Part c): The claim is NOT supported by the data. If exercising guaranteed low stress, then every person who exercises would also report low stress, meaning P(E ∩ L) would equal P(E) = 0.40. However, P(E ∩ L) = 0.30, which is less than 0.40. This means that of the 400 adults who exercise, only 300 (75%) report low stress, while 100 (25%) do not. Since not all exercisers report low stress, the headline's absolute claim is false. Point 4 (Part d): Two events E and L are independent if and only if P(E ∩ L) = P(E) × P(L). Here, P(E) × P(L) = 0.40 × 0.55 = 0.22. The observed P(E ∩ L) = 0.30, which exceeds 0.22. Since 0.30 ≠ 0.22, E and L are NOT independent in this sample. The fact that P(E ∩ L) > P(E) × P(L) indicates a positive association: exercisers are more likely to report low stress than would be expected under independence. However, this observational study cannot establish causation.

SUMMARY

Lesson Summary

Summary

Probability assigns a number between 0 and 1 to every event in a sample space, governed by Kolmogorov's three axioms: non-negativity, normalization (P(S) = 1), and additivity for mutually exclusive events. From these axioms follow the complement rule P(Aᶜ) = 1 − P(A) and the General Addition Rule P(A ∪ B) = P(A) + P(B) − P(A ∩ B), which corrects for double-counting when events overlap.

Probability can be interpreted through the classical (equally likely outcomes), empirical (long-run relative frequency), or subjective (personal degree of belief) lens, with the Law of Large Numbers guaranteeing that empirical frequencies converge to true probabilities. These foundational rules set the stage for conditional probability, independence, random variables, and the probability distributions that drive all of statistical inference.

Varsity Tutors • AP Statistics • Introduction to Probability