Introduction to Experimental Design
Help Questions
AP Statistics › Introduction to Experimental Design
A principal wants to test whether a new tutoring program improves algebra test scores. One hundred 9th-grade students who are currently enrolled in algebra are available. The principal labels the students 1–100 and uses a random number generator to select 50 students to receive tutoring; the remaining 50 do not receive tutoring. After 6 weeks, all students take the same algebra test; the response variable is test score. Which statement best describes what the random number generator is used for in this study?
It randomly samples students from all 9th graders in the district to improve generalizability
It makes the response variable categorical rather than quantitative
It guarantees that the tutoring program will cause higher scores for every student
It ensures that exactly half of the students will improve their scores
It randomly assigns students to tutoring or no tutoring to reduce confounding
Explanation
This question directly asks about the purpose of using a random number generator in the experimental setup. The correct answer is A because the random number generator is used to randomly assign students to receive tutoring or not, which is the defining feature that makes this an experiment rather than an observational study. This random assignment ensures that factors like prior math ability, motivation, or study habits are balanced between groups on average, reducing confounding. Option B incorrectly describes random sampling from a population, which isn't what's happening—the 100 students are already identified. Options C and D make unrealistic claims about guarantees, while E is simply false. The key concept is recognizing that random number generators in experimental contexts are tools for implementing random assignment, creating the foundation for causal inference by ensuring treatment assignment is independent of participant characteristics.
A school nurse wants to test whether a new 5-minute breathing routine reduces students’ test anxiety. She recruits 80 volunteers from the school (students who sign up after an announcement). Each student completes a short anxiety survey (0–40) right before a practice exam. Then the nurse uses a random number generator to assign 40 students to do the breathing routine and 40 students to sit quietly for 5 minutes (control). All students then take the same practice exam and complete the same anxiety survey immediately afterward; the response variable is the change in anxiety score (after − before). Which feature of this study allows the nurse to make a cause-and-effect conclusion about the routine’s effect on anxiety?
Randomly assigning students to the breathing routine or the control condition
Using volunteers from the school to obtain a large sample size
Using the same anxiety survey for all students
Having a control group that sits quietly for the same amount of time
Measuring anxiety both before and after the practice exam
Explanation
This question tests understanding of what enables causal inference in experimental design. The key principle that allows cause-and-effect conclusions is random assignment of subjects to treatment groups. By using a random number generator to assign students to either the breathing routine or control condition, the nurse ensures that any pre-existing differences between students (like natural anxiety levels, test-taking ability, or other factors) are distributed roughly equally between groups. This random assignment creates comparable groups on average, so any observed difference in anxiety change can be attributed to the breathing routine rather than confounding variables. While having a control group, consistent measurement, and pre/post design are all good experimental features, only random assignment provides the foundation for causal inference.
A psychologist studies whether a 10-minute daily journaling routine reduces anxiety. She recruits 72 participants and measures anxiety score after 4 weeks. Participants are first grouped by baseline anxiety level (low, medium, high), and within each group, she randomly assigns half to journaling and half to no journaling. Which best describes why the psychologist grouped participants by baseline anxiety before random assignment?
To ensure the treatment causes anxiety changes in every participant
To increase the sample size within each treatment group
To block on a variable related to the response and reduce variability
To create a placebo group for comparison
To perform random sampling from the population
Explanation
This AP Statistics question explores the purpose of blocking in experiments. The reason for grouping by baseline anxiety is to block on a related variable and reduce variability, as in choice C, improving treatment effect estimates. Choice A is a distractor, as blocking is not random sampling, which selects from a population. Mini-lesson: Blocking categorizes by a factor (anxiety level) then randomizes within blocks to control variability from that factor. This is useful when the blocking variable affects the response (anxiety score). It enhances precision without biasing assignment. The design supports causation within blocks.
A nutrition teacher wants to test whether eating a high-protein breakfast improves attention in first-period class. She recruits 72 students who usually skip breakfast. On Monday, she randomly assigns half to eat a provided high-protein breakfast and half to eat a provided low-protein breakfast. During first period, the teacher records each student’s attention score using a standardized rubric (0–20); this score is the response variable. Which aspect of the design is an example of control?
Providing breakfasts to both groups so the setting and timing are similar
Recruiting only students who usually skip breakfast
Using 72 students to increase the sample size
Recording attention scores as numbers from 0 to 20
Randomly assigning students to high-protein or low-protein breakfast
Explanation
This question tests understanding of control as a principle in experimental design. Control refers to keeping conditions as similar as possible between treatment groups except for the variable being tested. By providing breakfasts to both groups (just varying the protein content), the teacher controls for factors like eating timing, food source, eating environment, and the act of eating breakfast itself. This ensures that any difference in attention scores can be attributed to protein content rather than to eating versus not eating, or eating at school versus at home. Random assignment creates comparable groups, and sample size affects precision, but the act of standardizing the breakfast experience exemplifies the control principle in experimental design.
A sports medicine clinic wants to test whether a new stretching routine reduces hamstring tightness. The explanatory variable is the stretching routine (new routine vs. standard routine), and the response variable is hamstring flexibility measured by a sit-and-reach score after 4 weeks. Eighty volunteers are recruited from the clinic and then randomly assigned to follow either the new routine or the standard routine, with both groups meeting weekly with the same trainer. Which feature of this study allows the researchers to make a cause-and-effect conclusion about the stretching routine and flexibility?
The study lasted 4 weeks, which is long enough to see improvement
Participants were randomly assigned to the two stretching routines
The volunteers were recruited from a clinic, so they represent people with hamstring tightness
Both groups met weekly with the same trainer
The response variable is measured numerically using a sit-and-reach score
Explanation
This question tests understanding of experimental design principles in AP Statistics, specifically what enables cause-and-effect conclusions. The key feature is random assignment of participants to the new or standard stretching routine, which helps ensure that any differences in hamstring flexibility are due to the routine rather than confounding variables. For example, choice A is a distractor because it addresses representation and generalizability, not causation. In experimental design, random assignment balances out both known and unknown factors between groups, making it possible to attribute outcomes to the treatment. Without it, lurking variables could explain differences, as seen in observational studies. This study uses volunteers from a clinic, limiting generalizability, but random assignment supports causation within the sample. Overall, this highlights how experiments differ from observations in establishing causality.
A researcher tests whether listening to a guided meditation audio reduces stress. The explanatory variable is audio type (guided meditation vs. neutral audiobook), and the response variable is a stress score from a questionnaire after 2 weeks. Participants are randomly assigned to one of the two audios, and both audios are delivered through identical-looking apps labeled only “Audio 1” and “Audio 2,” so participants do not know which type they receive. Which feature is primarily intended to reduce the placebo effect?
Random assignment to guided meditation or neutral audiobook
Random sampling of participants from the community
Using a questionnaire to measure stress
Replication by using many participants in each group
Blinding participants to which audio type they receive
Explanation
In AP Statistics, this question examines blinding to reduce placebo effects in experimental design. Labeling audios neutrally blinds participants, preventing expectations from influencing stress scores. Choice C is a distractor; random assignment balances groups, but blinding targets perception bias. Placebo effects occur when beliefs affect outcomes, so blinding ensures true treatment effects. Both groups get audio, controlling for attention. Questionnaires measure subjectively, making blinding key. This feature enhances the study's validity for causation.
A school nurse wants to test whether a new mindfulness app reduces students’ stress. She recruits 60 volunteers from one high school and measures each student’s stress score (0–50 scale) after 2 weeks. Students’ names are put in a hat and 30 are randomly assigned to use the mindfulness app daily; the other 30 are assigned to continue their usual routine. The nurse compares the mean stress scores between groups. Which feature of this design allows a cause-and-effect conclusion about the app’s impact on stress?
The nurse compared the two group means after 2 weeks
The nurse measured stress using a 0–50 scale
The nurse used 60 students, which is a large sample
The students were volunteers from one high school
Students were randomly assigned to app or usual routine
Explanation
This question assesses understanding of experimental design in AP Statistics, specifically what allows for cause-and-effect conclusions. The key feature is random assignment of students to the mindfulness app or usual routine, as in choice C, which helps balance lurking variables between groups and isolates the app's effect. A common distractor is choice A, where using volunteers from one school limits generalizability but does not prevent causation within the sample. In experimental design, random assignment is crucial because it creates comparable groups, minimizing confounding factors. Without it, differences in outcomes could be due to pre-existing group differences rather than the treatment. This design demonstrates a controlled experiment where the explanatory variable is app usage and the response is stress score. Overall, it allows inferring that any observed difference in means is likely caused by the app.
A dermatologist tests whether a new acne cream reduces the number of pimples after 6 weeks. The explanatory variable is cream type (new cream vs. standard cream), and the response variable is the change in pimple count from baseline to 6 weeks. Each participant applies the new cream to the left side of the face and the standard cream to the right side, with the side assignments randomized for each person. Which feature of this design most directly helps control for person-to-person differences in acne severity?
Randomly assigning which side of the face gets which cream for each participant
Studying participants for 6 weeks rather than 2 weeks
Having each participant receive both treatments (matched pairs)
Recruiting participants from a dermatologist’s office
Using a numerical response variable (change in pimple count)
Explanation
The question in AP Statistics explores matched-pairs design to control variability. Having each participant receive both treatments (new cream on one side, standard on the other) directly controls for person-to-person differences in acne severity by comparing within individuals. Choice B is a distractor; randomizing sides is good but secondary to the matched-pairs structure. Matched pairs reduce variability from individual factors, improving treatment effect detection. This design is like blocking on the individual level. Recruitment source affects generalizability, not control. Thus, it exemplifies how pairing minimizes confounding in experiments.
A nutrition researcher wants to test whether caffeine affects reaction time. The explanatory variable is drink type (caffeinated vs. decaf), and the response variable is reaction time on a computer task 30 minutes after drinking. Participants are randomly assigned to one of the two drinks, but the researcher who administers the reaction-time task knows which drink each participant received and gives extra encouragement to the caffeinated group. Which feature would best address this potential source of bias?
Increase the sample size so random assignment works better
Blind the person administering the reaction-time task to drink type
Measure reaction time twice and average the results
Use a matched-pairs design instead of two independent groups
Randomly sample participants from the entire city
Explanation
This AP Statistics question examines bias reduction in experimental design, particularly experimenter bias. Blinding the person administering the reaction-time task to drink type prevents them from unconsciously influencing results, like giving extra encouragement to the caffeinated group. Choice C is a distractor as matched pairs control for individual differences, not this bias. Blinding is key in experiments to ensure objective measurement and avoid placebo or observer effects. Here, random assignment is already used, but without blinding, knowledge of treatment can skew administration. Adding blinding strengthens causal inference about caffeine's effect. This mini-lesson shows how design features like blinding enhance validity.
A public health team tests two methods for increasing daily steps: sending motivational texts or giving a wearable step-counter with daily reminders. The explanatory variable is intervention type (texts vs. wearable), and the response variable is the average number of steps per day over 1 month. Participants are randomly assigned to one intervention, but several in the wearable group stop wearing the device after the first week and are excluded from the analysis. Which issue is most likely introduced by excluding those participants?
Placebo effect because the wearable is not a real treatment
Nonresponse bias due to random sampling from too small a population
Confounding because the explanatory variable was not measured numerically
Bias from lack of blinding because participants knew their assignment
Attrition that can undermine the benefits of random assignment
Explanation
In AP Statistics, this question addresses attrition in experimental design and its impact on validity. Excluding participants who stopped using the wearable undermines random assignment benefits, as it may introduce bias if dropouts differ systematically. Choice C is a distractor, focusing on blinding, which isn't the issue here. Attrition can create non-comparable groups, losing randomization's balance. Intent-to-treat analysis might help, but exclusion risks bias. Random assignment initially balances, but dropouts disrupt it. This illustrates how real-world issues like noncompliance affect experimental integrity.