AP Statistics Quiz: Introduction To Experimental Design

What this quiz covers

This quiz focuses on Introduction To Experimental Design, giving you a quick way to practice the rules, question types, and explanations that matter most for AP Statistics.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

Question 1

1. It randomly assigns students to tutoring or no tutoring to reduce confounding (correct answer)
2. It randomly samples students from all 9th graders in the district to improve generalizability
3. It ensures that exactly half of the students will improve their scores
4. It guarantees that the tutoring program will cause higher scores for every student
5. It makes the response variable categorical rather than quantitative

Explanation: This question directly asks about the purpose of using a random number generator in the experimental setup. The correct answer is A because the random number generator is used to randomly assign students to receive tutoring or not, which is the defining feature that makes this an experiment rather than an observational study. This random assignment ensures that factors like prior math ability, motivation, or study habits are balanced between groups on average, reducing confounding. Option B incorrectly describes random sampling from a population, which isn't what's happening—the 100 students are already identified. Options C and D make unrealistic claims about guarantees, while E is simply false. The key concept is recognizing that random number generators in experimental contexts are tools for implementing random assignment, creating the foundation for causal inference by ensuring treatment assignment is independent of participant characteristics.

Question 2

1. Using volunteers from the school to obtain a large sample size
2. Measuring anxiety both before and after the practice exam
3. Randomly assigning students to the breathing routine or the control condition (correct answer)
4. Having a control group that sits quietly for the same amount of time
5. Using the same anxiety survey for all students

Explanation: This question tests understanding of what enables causal inference in experimental design. The key principle that allows cause-and-effect conclusions is random assignment of subjects to treatment groups. By using a random number generator to assign students to either the breathing routine or control condition, the nurse ensures that any pre-existing differences between students (like natural anxiety levels, test-taking ability, or other factors) are distributed roughly equally between groups. This random assignment creates comparable groups on average, so any observed difference in anxiety change can be attributed to the breathing routine rather than confounding variables. While having a control group, consistent measurement, and pre/post design are all good experimental features, only random assignment provides the foundation for causal inference.

Question 3

1. To perform random sampling from the population
2. To create a placebo group for comparison
3. To block on a variable related to the response and reduce variability (correct answer)
4. To ensure the treatment causes anxiety changes in every participant
5. To increase the sample size within each treatment group

Explanation: This AP Statistics question explores the purpose of blocking in experiments. The reason for grouping by baseline anxiety is to block on a related variable and reduce variability, as in choice C, improving treatment effect estimates. Choice A is a distractor, as blocking is not random sampling, which selects from a population. Mini-lesson: Blocking categorizes by a factor (anxiety level) then randomizes within blocks to control variability from that factor. This is useful when the blocking variable affects the response (anxiety score). It enhances precision without biasing assignment. The design supports causation within blocks.

Question 4

1. Recruiting only students who usually skip breakfast
2. Randomly assigning students to high-protein or low-protein breakfast
3. Providing breakfasts to both groups so the setting and timing are similar (correct answer)
4. Using 72 students to increase the sample size
5. Recording attention scores as numbers from 0 to 20

Explanation: This question tests understanding of control as a principle in experimental design. Control refers to keeping conditions as similar as possible between treatment groups except for the variable being tested. By providing breakfasts to both groups (just varying the protein content), the teacher controls for factors like eating timing, food source, eating environment, and the act of eating breakfast itself. This ensures that any difference in attention scores can be attributed to protein content rather than to eating versus not eating, or eating at school versus at home. Random assignment creates comparable groups, and sample size affects precision, but the act of standardizing the breakfast experience exemplifies the control principle in experimental design.

Question 5

1. The volunteers were recruited from a clinic, so they represent people with hamstring tightness
2. The response variable is measured numerically using a sit-and-reach score
3. Participants were randomly assigned to the two stretching routines (correct answer)
4. Both groups met weekly with the same trainer
5. The study lasted 4 weeks, which is long enough to see improvement

Explanation: This question tests understanding of experimental design principles in AP Statistics, specifically what enables cause-and-effect conclusions. The key feature is random assignment of participants to the new or standard stretching routine, which helps ensure that any differences in hamstring flexibility are due to the routine rather than confounding variables. For example, choice A is a distractor because it addresses representation and generalizability, not causation. In experimental design, random assignment balances out both known and unknown factors between groups, making it possible to attribute outcomes to the treatment. Without it, lurking variables could explain differences, as seen in observational studies. This study uses volunteers from a clinic, limiting generalizability, but random assignment supports causation within the sample. Overall, this highlights how experiments differ from observations in establishing causality.

Question 6

1. Random sampling of participants from the community
2. Replication by using many participants in each group
3. Random assignment to guided meditation or neutral audiobook
4. Blinding participants to which audio type they receive (correct answer)
5. Using a questionnaire to measure stress

Explanation: In AP Statistics, this question examines blinding to reduce placebo effects in experimental design. Labeling audios neutrally blinds participants, preventing expectations from influencing stress scores. Choice C is a distractor; random assignment balances groups, but blinding targets perception bias. Placebo effects occur when beliefs affect outcomes, so blinding ensures true treatment effects. Both groups get audio, controlling for attention. Questionnaires measure subjectively, making blinding key. This feature enhances the study's validity for causation.

Question 7

1. The students were volunteers from one high school
2. The nurse measured stress using a 0–50 scale
3. Students were randomly assigned to app or usual routine (correct answer)
4. The nurse used 60 students, which is a large sample
5. The nurse compared the two group means after 2 weeks

Explanation: This question assesses understanding of experimental design in AP Statistics, specifically what allows for cause-and-effect conclusions. The key feature is random assignment of students to the mindfulness app or usual routine, as in choice C, which helps balance lurking variables between groups and isolates the app's effect. A common distractor is choice A, where using volunteers from one school limits generalizability but does not prevent causation within the sample. In experimental design, random assignment is crucial because it creates comparable groups, minimizing confounding factors. Without it, differences in outcomes could be due to pre-existing group differences rather than the treatment. This design demonstrates a controlled experiment where the explanatory variable is app usage and the response is stress score. Overall, it allows inferring that any observed difference in means is likely caused by the app.

Question 8

1. Using a numerical response variable (change in pimple count)
2. Randomly assigning which side of the face gets which cream for each participant
3. Having each participant receive both treatments (matched pairs) (correct answer)
4. Studying participants for 6 weeks rather than 2 weeks
5. Recruiting participants from a dermatologist's office

Explanation: The question in AP Statistics explores matched-pairs design to control variability. Having each participant receive both treatments (new cream on one side, standard on the other) directly controls for person-to-person differences in acne severity by comparing within individuals. Choice B is a distractor; randomizing sides is good but secondary to the matched-pairs structure. Matched pairs reduce variability from individual factors, improving treatment effect detection. This design is like blocking on the individual level. Recruitment source affects generalizability, not control. Thus, it exemplifies how pairing minimizes confounding in experiments.

Question 9

1. Increase the sample size so random assignment works better
2. Randomly sample participants from the entire city
3. Use a matched-pairs design instead of two independent groups
4. Blind the person administering the reaction-time task to drink type (correct answer)
5. Measure reaction time twice and average the results

Explanation: This AP Statistics question examines bias reduction in experimental design, particularly experimenter bias. Blinding the person administering the reaction-time task to drink type prevents them from unconsciously influencing results, like giving extra encouragement to the caffeinated group. Choice C is a distractor as matched pairs control for individual differences, not this bias. Blinding is key in experiments to ensure objective measurement and avoid placebo or observer effects. Here, random assignment is already used, but without blinding, knowledge of treatment can skew administration. Adding blinding strengthens causal inference about caffeine's effect. This mini-lesson shows how design features like blinding enhance validity.

Question 10

1. Nonresponse bias due to random sampling from too small a population
2. Confounding because the explanatory variable was not measured numerically
3. Bias from lack of blinding because participants knew their assignment
4. Attrition that can undermine the benefits of random assignment (correct answer)
5. Placebo effect because the wearable is not a real treatment

Explanation: In AP Statistics, this question addresses attrition in experimental design and its impact on validity. Excluding participants who stopped using the wearable undermines random assignment benefits, as it may introduce bias if dropouts differ systematically. Choice C is a distractor, focusing on blinding, which isn't the issue here. Attrition can create non-comparable groups, losing randomization's balance. Intent-to-treat analysis might help, but exclusion risks bias. Random assignment initially balances, but dropouts disrupt it. This illustrates how real-world issues like noncompliance affect experimental integrity.

Question 11

1. Random sampling of schools from the district
2. Blocking by school before random assignment (correct answer)
3. Using a large sample size across the district
4. Blinding the students to which program they receive
5. Using a standardized test as the response variable

Explanation: In AP Statistics, this question focuses on blocking in experimental design to control for variability. Blocking by school before random assignment reduces the effect of school differences, like resources, by ensuring both programs are tested within each school. A distractor like choice A mentions random sampling, which is for generalizability, not controlling variability within the experiment. Blocking is a design principle where subjects are grouped by a characteristic (here, schools) before randomizing treatments, minimizing its impact on the response. This allows a fairer comparison of reading programs. Without blocking, school differences could confound results. The large sample and standardized test help, but blocking directly addresses inter-school variability.

Question 12

1. It is random assignment, so there is no problem
2. It is not truly random, so lurking patterns in arrival order could bias results (correct answer)
3. It uses random sampling rather than random assignment
4. It guarantees a placebo effect in the warm group
5. It prevents replication because each participant is used only once

Explanation: The question in AP Statistics evaluates random assignment methods in experimental design. Alternating arrivals isn't truly random, allowing lurking patterns (like time of day) to bias temperature groups. Choice A is a distractor, wrongly claiming it's fine as random assignment. True random assignment uses chance to avoid systematic differences. This method is systematic, not random, potentially confounding results. Better methods include random number generators. It highlights why proper randomization is crucial for causation.

Question 13

1. The greenhouse setting
2. The yield in grams per plant after 8 weeks
3. The type of fertilizer applied (A or B) (correct answer)
4. The number of plants in the experiment (40)
5. The random number generator used for assignment

Explanation: This question in AP Statistics examines identifying variables in experimental design. The explanatory variable is the type of fertilizer (A or B), as in choice C, which is manipulated to observe its effect on yield. Choice B is a distractor as it describes the response variable, yield in grams, not the explanatory one. Mini-lesson: In experiments, the explanatory variable is the treatment applied (fertilizer type), while the response is the outcome measured (yield). Random assignment, via a generator (choice E), ensures fair comparison but is not the explanatory variable. The greenhouse setting controls environment but is not the variable of interest. This setup tests causal impact of fertilizer on plant growth.

Question 14

1. The runners were selected from a list of club members
2. The researchers used a placebo drink for comparison
3. The response variable was measured in seconds
4. Each runner was randomly assigned to sports drink or placebo (correct answer)
5. All runners used the same indoor track

Explanation: In AP Statistics, this question focuses on identifying elements of experimental design that support causation, particularly in comparative studies. The best feature for cause-and-effect is random assignment via coin flip to sports drink or placebo, as in choice D, ensuring groups are similar except for the treatment. Choice B, using a placebo, is a distractor because while it controls for psychological effects, it alone does not balance lurking variables without randomization. A mini-lesson on experimental design: experiments require manipulation of an explanatory variable (here, drink type) and measurement of a response (run time), with randomization to enable causal claims. Controlling conditions like the same track (choice E) reduces variability but does not directly support causation. This setup allows concluding that differences in run times are due to the drink. Remember, observational studies lack this randomization and cannot establish cause.

Question 15

1. The response variable is final exam score
2. The comparison is between two groups (tutoring vs no tutoring)
3. Students self-select into tutoring by requesting extra help (correct answer)
4. The study includes many students (240)
5. The study is conducted over an entire term

Explanation: This AP Statistics question identifies limitations in non-randomized designs for causation. The limiting feature is self-selection into tutoring, as in choice C, introducing confounding since motivated students might differ inherently. Choice B, comparing two groups, is a distractor as comparison is needed but ineffective without randomization. Mini-lesson: For cause-and-effect, experiments need random assignment to avoid self-selection bias, where groups differ in ways unrelated to treatment. Here, requesters might be more dedicated, confounding exam score differences. Large sample (choice D) does not fix non-randomization. This is an observational study, not a true experiment.

Question 16

1. Package color (red or blue)
2. Whether the volunteer likes cookies in general
3. The sweetness rating on the 1–10 scale (correct answer)
4. The fact that all cookies came from one batch
5. The number of volunteers (50)

Explanation: This question in AP Statistics focuses on distinguishing variables in experimental contexts. The response variable is the sweetness rating on a 1–10 scale, as in choice C, measuring the outcome of interest. Choice A is a distractor, as package color is the explanatory variable manipulated in the experiment. Mini-lesson: The response variable is what is measured to assess treatment effects, while explanatory is what is changed (color). Random assignment to colors ensures fair comparison. Using one batch controls consistency but is not the response. This design tests perceptual effects on ratings.

Question 17

1. Random assignment, because patients were not randomly assigned to checklist type (correct answer)
2. Random sampling, because patients were not randomly sampled from the city
3. Replication, because the study lasted three months
4. Use of a response variable, because readmission is not measurable
5. Use of an explanatory variable, because checklist type cannot be changed

Explanation: This question tests recognition of a fundamental violation of experimental design principles. The correct answer is A because assigning entire wards to different treatments violates random assignment, making it impossible to separate the effect of the checklist from ward-specific factors. Ward 1 and Ward 2 likely differ in patient populations, staff practices, or other characteristics that could affect readmission rates independently of the checklist. Without random assignment of patients to checklist types, any observed differences might be due to these ward differences rather than the checklist itself. Choice B is about generalizability, not internal validity. The key lesson is that random assignment at the appropriate unit level (individual patients, not whole wards) is essential for valid causal conclusions in experiments.

Question 18

1. Because customers were randomly assigned, any difference in open rates can be interpreted as caused by the subject line (correct answer)
2. Because the company used a very large list, the results automatically generalize to all email users everywhere
3. Because customers were randomly assigned, the study is a random sample of all customers in the country
4. Because the response variable is categorical, the study cannot support cause-and-effect conclusions
5. Because the company used two treatments, it is an observational study rather than an experiment

Explanation: This question tests understanding of what conclusions random assignment supports versus what it doesn't. The correct answer is A because random assignment of customers to different subject lines creates comparable groups, allowing any difference in open rates to be attributed to the subject line rather than customer characteristics. Option B incorrectly claims the results generalize broadly—random assignment supports causal inference but doesn't ensure external validity beyond the company's customer list. Option C confuses random assignment with random sampling; this study uses the former, not the latter. The key distinction is that random assignment enables cause-and-effect conclusions about the treatments tested, while random sampling would be needed to generalize results to a broader population. Students must understand that internal validity (causation) and external validity (generalization) are separate concepts requiring different design features.

Question 19

1. Using a binary response variable (purchase vs. no purchase)
2. Having a large number of visitors participate
3. Random assignment of visitors to layouts (correct answer)
4. Comparing two layouts instead of three
5. Studying visitors as they naturally arrive online

Explanation: This AP Statistics question focuses on random assignment's role in experimental design. Randomly assigning visitors to layouts ensures differences in purchase rates are due to layouts, not preexisting visitor differences. Choice B is a distractor; large samples help precision, but random assignment directly balances groups. Without it, self-selection could confound results. This A/B testing is common in online experiments. Natural arrival aids realism, but randomization enables causation. It demonstrates how experiments isolate treatment effects.

Question 20

1. A cause-and-effect conclusion is justified for the volunteers, but generalizing to all college students may not be (correct answer)
2. A cause-and-effect conclusion is not justified because the students were not randomly sampled
3. Generalizing to all college students is justified because a coin flip was used
4. Both causation and generalization to all college students are justified
5. Neither causation nor generalization is justified because the response variable is a score

Explanation: This AP Statistics question assesses causation and generalizability in experimental design. Random assignment justifies causation for volunteers, but lack of random sampling limits generalizing to all college students. Choice D is a distractor, overstating by claiming both are justified without random sampling. Experiments establish cause via random assignment, but generalizability requires representative samples. Coin flips ensure balanced groups for causation. Volunteers may differ from broader populations, so conclusions apply to similar groups. This distinguishes internal validity (causation) from external validity (generalization).