- A school newspaper reports a link between students' participation in after-school clubs and their GPA. A reporter collects data by looking up GPA in school records and recording each student's number of clubs from the activities database. No one is told to join or not join clubs. Which type of study is described?
Answer: Observational study, because variables are measured from records and no treatment is assigned
In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the reporter observes GPA and club participation from records without assigning any treatment like joining clubs, making it an observational study that can show associations but not causation. A common misconception is that comparing groups means it's an experiment, but without random assignment, factors like motivation could confound the GPA-club link. To classify future studies, ask: 'Did researchers assign a treatment?' (no, so observational) and 'Was the sample randomly selected?' (not specified, but focus is on lack of treatment).
- A tutoring center wants to know whether online tutoring or in-person tutoring leads to higher algebra test scores. They recruit 80 students who sign up for tutoring and then randomly assign each student to receive either online tutoring or in-person tutoring for four weeks. At the end, all students take the same algebra test. What does the randomization (if any) allow the tutoring center to conclude?
Answer: Because students were randomly assigned to tutoring type, differences in test scores can be attributed to the tutoring type (causal conclusion) for these 80 students
This scenario illustrates the distinction between experiments and other study types based on treatment assignment. An experiment occurs when researchers assign subjects to different treatment conditions—here, the tutoring center assigns students to either online or in-person tutoring. Random sampling involves selecting subjects from a larger population using chance to support generalization to that population. Random assignment uses chance to determine which treatment each subject receives, supporting causal conclusions about treatment effects. In this study, students volunteer (not random sampling), so results don't automatically generalize beyond these 80 students. However, the random assignment of tutoring type means any difference in test scores can be attributed to the tutoring method rather than pre-existing differences between groups. The key insight is that random assignment allows causal conclusions for the subjects in the study, while random sampling would be needed to generalize to a broader population. Ask yourself: Did researchers assign a treatment? Yes, so it's an experiment with causal conclusions possible.
- To study whether background music affects study efficiency, a researcher recruits 60 volunteers from one high school. Each volunteer is randomly assigned to one of three conditions while completing the same 30-minute practice set: no music, instrumental music, or music with lyrics. Time to finish and number correct are recorded. Which type of study is described?
Answer: Experiment, because the researcher imposes a music condition (treatment) through random assignment
In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the researcher recruits volunteers and randomly assigns them to music conditions while they complete a practice set, making it an experiment to test music's effect on study efficiency. A common misconception is that volunteers create a random sample, but here random assignment supports causation, while the non-random sample limits generalization beyond volunteers. To classify future studies, ask: 'Did researchers assign a treatment?' (yes, music conditions) and 'Was the sample randomly selected?' (no, volunteers).
- A student council wants to estimate the proportion of students at their high school who would support adding a 10-minute break between 2nd and 3rd period. They use a random number generator to select 120 students from the school enrollment list and email them a short questionnaire asking whether they support the change. Which type of study is described?
Answer: Sample survey, because a random sample of students is asked questions and no treatment is assigned
This scenario asks us to identify the type of study based on whether researchers assigned a treatment. In this case, the student council randomly selects 120 students from the enrollment list and emails them a questionnaire asking about their support for a schedule change. The key feature that distinguishes experiments is that researchers assign a treatment to participants, but here, no treatment is assigned—students are simply asked their opinion. Random sampling from the enrollment list means the council can generalize their findings to the whole school population. Random assignment would involve assigning different conditions to students, which doesn't happen here. Since the council only collects opinions through questions without manipulating any variables, this is a sample survey. A common misconception is thinking that any use of randomization makes something an experiment, but random sampling (selecting who to ask) is different from random assignment (assigning treatments).
- A librarian wants to know whether students prefer e-books or printed books. She uses a random number generator to choose 200 student ID numbers from the school database and emails those students a one-question poll asking for their preference. Which type of study is described, and what does the randomization allow?
Answer: Sample survey; random sampling supports generalizing the estimated preference proportion to the whole school.
Types of studies—surveys, observational, experiments—are differentiated by methods, and randomization supports either generalizing to populations or establishing causation. Experiments require assigning treatments, but here the librarian only polled preferences without intervention. Random sampling selects randomly from a population, allowing generalization, as with choosing student IDs. Random assignment to groups enables causal conclusions. This sample survey uses random sampling to generalize the preference proportion to the school, but without assignment, no causation about formats. A common error is thinking random sampling equals random assignment, but sampling generalizes while assignment causes—here, only generalization. To classify, ask: 'Did researchers assign a treatment?' (no, survey) and 'Was the sample randomly selected?' (yes, supporting generalization).
- A district researcher wants to test whether background music helps students complete independent work faster. She randomly selects 10 classrooms from the district, then randomly assigns 5 of those classrooms to play instrumental music during a 20-minute work period and the other 5 to have no music. She records average completion time in each classroom. Which statement correctly distinguishes random sampling and random assignment in this study?
Answer: Randomly selecting classrooms supports generalizing results to the district's classrooms; randomly assigning classrooms to music vs no music supports a causal conclusion about music's effect on completion time.
Study types including experiments, surveys, and observational studies are identified by design elements, with randomization enabling specific conclusions like causation or generalization. The key feature of experiments is assigning treatments, here random assignment of classrooms to music or no music. Random sampling from a population supports generalizing results to that population, as with selecting classrooms from the district. Random assignment to groups supports causal claims by controlling for confounders. In this experiment, random sampling allows generalization to district classrooms, while random assignment enables concluding music affects completion time. A misconception is swapping the roles: sampling generalizes, assignment causes—both are correctly applied here at classroom level. To apply elsewhere, ask: 'Did researchers assign a treatment?' (yes, experiment) and 'Was the sample randomly selected?' (yes, supporting generalization).
- A researcher wants to estimate the average number of hours of sleep students at a large high school get on school nights. She stands in the cafeteria at lunch and asks the first 80 students who walk by to report how many hours they slept last night. Which statement about randomization is most accurate?
Answer: This is not a random sample, so generalizing to the entire school may be biased
This scenario illustrates the importance of random sampling for generalization. The researcher wants to estimate average sleep hours for all students at the school, but she uses convenience sampling by asking the first 80 students who walk by in the cafeteria. This is not random sampling because every student doesn't have an equal chance of being selected—students who don't eat in the cafeteria or who eat at different times have no chance of inclusion. Random assignment isn't relevant here because no treatment is being assigned; the researcher is simply collecting data. Without random sampling, the estimate may be biased and not represent the entire school population. For instance, students who eat lunch early might have different sleep patterns than those who eat later. Since this is data collection without treatment assignment, it's a sample survey, but a poorly designed one. The key issue: convenience sampling prevents reliable generalization to the whole school.
- A school administrator wants to examine the relationship between sleep and grades. For one month, volunteers from the school record how many hours they sleep each night, and the administrator later compares their average sleep hours with their report-card averages. No one is told to change their sleep. Which type of study is described?
Answer: Observational study, because sleep is measured but not assigned as a treatment
Understanding types of studies requires identifying whether researchers assign a treatment. An experiment involves researchers actively assigning subjects to different treatment conditions, while an observational study involves measuring variables without manipulating them. Random sampling selects subjects from a population to support generalization, while random assignment allocates treatments to support causal conclusions. In this scenario, the administrator is measuring two existing variables—sleep hours and grades—without telling anyone to change their sleep patterns. Students sleep however much they normally would, making this an observational study. The use of volunteers (not random sampling) means results may not generalize well to the whole school. A common misconception is thinking that having different groups (like high-sleep vs. low-sleep students) makes something an experiment, but the key question is: Did researchers assign the treatment? Since students chose their own sleep hours, this remains observational.
- A school wants to see whether sitting in the front of the classroom improves attention during lectures. For one month, students are randomly assigned seats: half are randomly assigned to front-row seats and half to back-row seats. Teachers then rate each student's attention using the same rubric. Which type of study is described, and what does the randomization allow?
Answer: Experiment; random assignment of seats supports a causal conclusion about seat location's effect on attention for the students studied.
Differentiating experiments from other studies involves checking for randomization's role in causation or generalization. Experiments are defined by assigning treatments, like randomly assigning seats to front or back. Random sampling selects from a population for generalization. Random assignment to groups supports causal conclusions, as here with seats affecting attention. This experiment uses random assignment to claim causation for the studied students, but without random sampling, generalization beyond is limited. Commonly, people think random assignment alone generalizes widely, but it enables causation—sampling is needed for broader inferences. For future studies, ask: 'Did researchers assign a treatment?' (yes, experiment) and 'Was the sample randomly selected?' (no, not generalizing).
- To learn whether a new note-taking template helps students remember vocabulary, a teacher has all students use the template for 2 weeks and then compares their vocabulary quiz scores to the class's quiz scores from the previous unit (when the template was not used). No random assignment is used. Which statement is most accurate?
Answer: This is not a well-designed experiment; without random assignment (and with a different unit), it is hard to make a causal conclusion
This scenario demonstrates why random assignment is crucial for establishing causation in experiments. The teacher does impose a treatment (the note-taking template) on all students, which might seem like an experiment. However, without random assignment to treatment and control groups, and with the comparison being to a different unit entirely, this is a poorly designed study that makes causal conclusions difficult. Random sampling isn't the issue—the teacher uses her existing class. The problem is that comparing scores from different units introduces confounding variables: the units might have different difficulty levels, students might have improved naturally over time, or other factors might have changed. While the teacher did impose a treatment, the lack of a proper control group (some students not using the template during the same unit) and random assignment means we cannot confidently claim the template caused any score differences. This is best described as a flawed attempt at an experiment that functions more like an observational study.
- A coach wants to see whether a new warm-up routine improves 1-mile run times. Two existing PE classes are used: one class does the new warm-up every day for three weeks, and the other class keeps the usual warm-up. The coach flips a coin to decide which class gets the new warm-up. At the end, all students run a timed mile. Which statement is correct about randomization in this study?
Answer: Classes were randomly assigned to treatments, supporting a causal conclusion, but the randomization unit is the class (not individual students)
Understanding randomization requires distinguishing between random sampling and random assignment, and recognizing the unit of randomization. An experiment assigns treatments, while random sampling selects from a population for generalization and random assignment allocates treatments for causal inference. In this study, the coach assigns one class to the new warm-up and another to the usual warm-up—this treatment assignment makes it an experiment. The coin flip represents random assignment at the class level, not individual level, since whole classes (not individual students) were randomly assigned to treatments. This cluster randomization still supports causal conclusions but recognizes that classes, not individuals, were the randomization units. The coach used existing PE classes rather than randomly sampling from all students, so results don't automatically generalize beyond these two classes. A common misconception is thinking randomization must occur at the individual level, but cluster randomization (randomizing groups) is valid for supporting causation, though it may affect the precision of estimates.
- A teacher wants to know whether using a spaced-practice app improves quiz scores. She randomly assigns students in her class to either (1) use the app for 10 minutes per day for two weeks or (2) study as they usually do for two weeks. Then everyone takes the same quiz. Which statement correctly distinguishes random sampling and random assignment in this study?
Answer: There is random assignment to treatments, which supports a causal conclusion about the app's effect for students in this class
To identify the type of study, we need to recognize that experiments involve researchers assigning a treatment to subjects. In this scenario, the teacher assigns students to either use the spaced-practice app or study as usual—this assignment of treatment makes it an experiment. Random sampling refers to selecting subjects from a larger population using chance, which supports generalizing results to that population. Random assignment means using chance to determine which treatment each subject receives, which supports causal conclusions about the treatment's effect. Here, the teacher randomly assigns treatments to students in her class, but she didn't randomly sample these students from a larger population—they're just the students in her existing class. Therefore, the random assignment supports a causal conclusion about the app's effect for students in this class, but without random sampling, we cannot generalize beyond this specific class. The key insight is that random assignment and random sampling serve different purposes: assignment for causation, sampling for generalization.
- A teacher wants to know whether using a flashcard app improves weekly vocabulary quiz scores. All students in the class take a baseline quiz, then the teacher randomly assigns half the students to use the app for 10 minutes each night and the other half to study as they normally do. After 3 weeks, the teacher compares quiz scores between the two groups. What does the random assignment allow the teacher to conclude (assuming the study is well run)?
Answer: Any difference in average quiz scores between groups can be attributed to the app more confidently (a cause-and-effect conclusion)
In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the teacher randomly assigns students to use the flashcard app or study normally, allowing a more confident causal conclusion about the app's effect on quiz scores. A common misconception is that random sampling alone enables causation, but here random assignment (not sampling, since it's the whole class) is what supports attributing differences to the app. To classify future studies, ask: 'Did researchers assign a treatment?' (yes, so experiment) and 'Was the sample randomly selected?' (no, but that's for generalization, not causation here).
- A principal wants to learn whether students who participate in after-school tutoring tend to have higher math grades. The principal collects last semester's math grades for students who chose to attend tutoring and for students who did not, and then compares the two groups. No one is assigned to tutoring by the school. Which statement best describes this study and what (if anything) it allows?
Answer: Observational study; it can show an association between tutoring and grades but cannot establish causation
To identify this study type, we need to determine whether the principal assigned students to tutoring. In this scenario, students chose for themselves whether to attend tutoring—the principal simply collected and compared grades afterward. This makes it an observational study because the principal observes existing groups without manipulating any variables. Random sampling would involve selecting students from a larger population, which didn't happen here. Random assignment would require the principal to assign some students to tutoring and others not to, which also didn't occur since students self-selected. Without random assignment, we cannot establish that tutoring causes higher grades—there might be confounding factors (like motivation) that lead both to choosing tutoring and earning higher grades. The study can show an association between tutoring attendance and grades, but cannot prove causation. The key question to ask: "Did the researcher assign the treatment?" Here, the answer is no.
- A school newspaper wants to know whether students who participate in a music program tend to spend more time studying. Reporters interview 100 students who happen to be in the library after school, asking (1) whether they are in a music program and (2) how many hours they studied last week. No one is assigned to join music or to study more. Which type of study is described?
Answer: Observational study, because the reporters measure variables without assigning a treatment
Identifying study types requires recognizing whether researchers assign treatments to subjects. An experiment involves researchers actively assigning different conditions, while an observational study measures existing characteristics without intervention. Random sampling selects subjects to represent a population, while random assignment allocates treatments to support causal conclusions. In this scenario, reporters are measuring two existing variables—music program participation and study hours—without assigning anyone to join music or study more. Students already either participate in music or don't, making this an observational study. The reporters use convenience sampling (students who happen to be in the library), not random sampling, which limits generalization. Being in the library after school might correlate with both music participation and study habits in ways that don't represent all students. The key question is: Did researchers assign a treatment? No—they're observing existing behaviors, making this observational despite having two groups to compare.
- A counselor wants to estimate the proportion of seniors who have completed a college application. The counselor surveys the first 80 seniors who arrive at a morning assembly and asks whether they have submitted at least one application. What is the main issue with using this sample?
Answer: Because the sample is not randomly selected, it may not represent all seniors (selection bias is possible)
In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the counselor surveys the first 80 seniors at an assembly, which is a non-random convenience sample, so it may not represent all seniors due to selection bias, like early arrivers being more organized. A common misconception is that a large sample size ensures representation, but without random sampling, generalization to all seniors is questionable. To classify future studies, ask: 'Did researchers assign a treatment?' (no) and 'Was the sample randomly selected?' (no).
- A student council wants to estimate the average number of hours of sleep students at their high school get on school nights. They use a random number generator to select 120 students from the school roster and email each selected student a short questionnaire asking, "How many hours did you sleep last night?" Which type of study is described?
Answer: Sample survey, because a random sample of students is asked a question and no treatment is assigned
In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the student council randomly selects 120 students and asks them about their sleep without assigning any treatment, making it a sample survey aimed at estimating average sleep hours for the whole school. A common misconception is that random sampling is the same as random assignment, but here there's random sampling for generalization, not assignment for causation. To classify future studies, ask: 'Did researchers assign a treatment?' (no, so not an experiment) and 'Was the sample randomly selected?' (yes, so results can generalize).
- A district wants to compare two homework policies (Policy A: 20 minutes/night; Policy B: 40 minutes/night) to see which leads to better unit test scores. The district randomly selects 10 schools from all district schools. Within each selected school, the district randomly assigns Policy A to half of the math classes and Policy B to the other half for one unit. Which statement correctly distinguishes random sampling and random assignment in this study?
Answer: Randomly selecting schools supports generalizing to the district; randomly assigning policies to classes supports causal conclusions about the policy
This complex study uses both random sampling and random assignment for different purposes. The district randomly selects 10 schools from all district schools—this is random sampling, which allows them to generalize findings to the entire district. Within each selected school, they randomly assign Policy A to half the math classes and Policy B to the other half—this is random assignment of a treatment, making this an experiment. Random sampling supports generalization: because schools were randomly selected, results can represent the whole district. Random assignment supports causal conclusions: because policies were randomly assigned to classes, differences in test scores can be attributed to the homework policy rather than other factors. The fact that classes (not individual students) were assigned doesn't invalidate the random assignment—it's still an experiment. Remember: random sampling answers "To whom do results apply?" while random assignment answers "What caused the results?"
- A coach wants to know whether listening to music during warm-ups improves free-throw percentage. Players choose for themselves whether to listen to music during warm-ups for a week, and the coach records each player's free-throw percentage at the end of the week. Which type of study is described?
Answer: Observational study, because players self-selected and no one was randomly assigned to music or no music
To classify this study, we must determine whether the coach assigned the treatment (listening to music). In this scenario, players chose for themselves whether to listen to music during warm-ups—the coach didn't assign anyone to either condition. This self-selection makes it an observational study, not an experiment, because the coach simply observed existing behaviors without manipulating variables. Random sampling isn't mentioned and isn't the key issue here. Random assignment would require the coach to randomly assign some players to listen to music and others not to, which didn't happen. Without random assignment, we cannot conclude that music causes changes in free-throw percentage—players who choose music might differ in other ways (like confidence or practice habits) that affect their performance. The study can show an association between music use and free-throw percentage but cannot establish causation. Remember: if participants choose their own treatment, it's observational, not experimental.
- A librarian wants to test whether a reminder text message increases the rate of on-time book returns. Each student who checks out a book is randomly assigned to either receive a reminder text 2 days before the due date or receive no text. The librarian then records whether each book is returned on time. Which type of study is described?
Answer: Experiment, because the librarian imposes a treatment (text vs no text) using random assignment
This is a clear example of an experiment because the librarian assigns a treatment using randomization. When students check out books, the librarian randomly assigns them to either receive a reminder text or no text—this is random assignment of a treatment. The key feature of experiments is that researchers manipulate variables by assigning treatments, which happens here. Random sampling would involve selecting which students to include in the study from a larger population, but here all students checking out books are included. The random assignment allows the librarian to make causal conclusions: if the text group has higher on-time return rates, the difference can be attributed to the reminder texts rather than other factors. This isn't an observational study because the librarian actively intervenes by sending texts to some students. The fact that the outcome (on-time return) is observed doesn't make it observational—what matters is that a treatment was assigned. Ask: "Did the researcher assign a treatment?" Yes, so it's an experiment.
