Statistics Quiz: Understanding Surveys Experiments And Observational Studies

What this quiz covers

This quiz focuses on Understanding Surveys Experiments And Observational Studies, giving you a quick way to practice the rules, question types, and explanations that matter most for Statistics.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

Question 1

1. Only random assignment occurred, because selecting classes at random does not count as random sampling
2. Random sampling supports causation, while random assignment supports generalizing to the whole district
3. Random sampling helps support generalizing to the district’s algebra classes, and random assignment of classes supports a causal comparison of tutoring formats (correct answer)
4. Only random sampling occurred, because assigning tutoring formats is just observing what teachers already do

Explanation: In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the district randomly selects 10 classes (random sampling for generalization to all algebra classes) and then randomly assigns them to in-person or online tutoring (random assignment for causal comparison of formats on test scores). A common misconception is mixing up the roles, but random sampling supports generalization, while random assignment supports causation. To classify future studies, ask: 'Did researchers assign a treatment?' (yes) and 'Was the sample randomly selected?' (yes).

Question 2

1. The results can be generalized to all students in the school because the class was randomly assigned
2. Any difference in average quiz scores between groups can be attributed to the app more confidently (a cause-and-effect conclusion) (correct answer)
3. The study is a sample survey, so it estimates the school’s average quiz score without bias
4. Any difference proves the app works for every individual student in the class

Explanation: In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the teacher randomly assigns students to use the flashcard app or study normally, allowing a more confident causal conclusion about the app's effect on quiz scores. A common misconception is that random sampling alone enables causation, but here random assignment (not sampling, since it's the whole class) is what supports attributing differences to the app. To classify future studies, ask: 'Did researchers assign a treatment?' (yes, so experiment) and 'Was the sample randomly selected?' (no, but that's for generalization, not causation here).

Question 3

1. Because participation is voluntary and not a random sample, the results may be biased and may not represent the whole school (correct answer)
2. Because there is no random assignment, the poll can establish that block scheduling causes higher preference
3. Because the poll is online, it is automatically a random sample of students
4. Because it is a survey, the results can be generalized to all students at the school without concern

Explanation: In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the principal posts an online poll with voluntary participation, which is a survey but lacks random sampling, so results may be biased and not generalizable to all students. A common misconception is that online polls are random samples, but voluntary response can overrepresent strong opinions on block scheduling. To classify future studies, ask: 'Did researchers assign a treatment?' (no) and 'Was the sample randomly selected?' (no, so generalization is limited).

Question 4

1. Experiment, because the reporter compares two groups (club vs no club)
2. Experiment, because GPA is the response variable and that means a treatment was applied
3. Sample survey, because using a database is the same as asking a random sample of students questions
4. Observational study, because variables are measured from records and no treatment is assigned (correct answer)

Explanation: In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the reporter observes GPA and club participation from records without assigning any treatment like joining clubs, making it an observational study that can show associations but not causation. A common misconception is that comparing groups means it's an experiment, but without random assignment, factors like motivation could confound the GPA-club link. To classify future studies, ask: 'Did researchers assign a treatment?' (no, so observational) and 'Was the sample randomly selected?' (not specified, but focus is on lack of treatment).

Question 5

1. Because there is no random assignment, the counselor cannot measure the proportion of seniors
2. Because the sample is not randomly selected, it may not represent all seniors (selection bias is possible) (correct answer)
3. Because the sample size is 80, the counselor has proven the true proportion for the entire senior class
4. Because the counselor asked a question, the results automatically generalize to all seniors

Explanation: In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the counselor surveys the first 80 seniors at an assembly, which is a non-random convenience sample, so it may not represent all seniors due to selection bias, like early arrivers being more organized. A common misconception is that a large sample size ensures representation, but without random sampling, generalization to all seniors is questionable. To classify future studies, ask: 'Did researchers assign a treatment?' (no) and 'Was the sample randomly selected?' (no).

Question 6

1. The coach can conclude drinking water causes lower fatigue because the athletes were all measured the same way
2. The coach used random sampling, so the results automatically generalize to all athletes everywhere
3. The coach can conclude any association may be due to other factors, so a cause-and-effect conclusion is not justified (correct answer)
4. This is a sample survey only if athletes were forced to drink water as a treatment

Explanation: In statistics, we distinguish between types of studies like surveys, observational studies, and experiments, and understand how randomization helps in making inferences about populations or causation. The key feature of an experiment is that researchers actively assign subjects to different treatments to observe their effects. Random sampling involves selecting subjects randomly from a population, which supports generalizing results from the sample to the broader population. Random assignment means randomly allocating subjects to treatment groups, which supports causal conclusions by balancing out confounding factors. In this scenario, the coach observes athletes' water drinking and fatigue without assigning any treatment, so it's an observational study where lack of random assignment means associations could be due to confounders like workout intensity, not causation. A common misconception is that measuring variables implies causation, but without assignment, cause-and-effect is not justified. To classify future studies, ask: 'Did researchers assign a treatment?' (no) and 'Was the sample randomly selected?' (not specified, but focus on lack of assignment).

Question 7

1. Because the final exam is the same for everyone, random assignment is unnecessary to prove the quizzes work.
2. Because there are two groups, the study is an experiment and supports a causal claim about the quizzes.
3. Because the department used many students, the results automatically generalize to all schools in the state.
4. Because students self-selected into quiz-taking, the comparison is observational and does not justify a causal claim that practice quizzes increase scores. (correct answer)

Explanation: Identifying study types like observational studies versus experiments hinges on design, with randomization key for causation or generalization. Experiments involve assigning treatments, but here students self-chose quiz participation, making it observational. Random sampling from a population supports generalizing results. Random assignment to groups allows causal claims. In this observational study, self-selection prevents causal claims about quizzes improving scores, as confounders may differ between groups. People often confuse group comparison with random assignment, but without assignment, causation isn't supported—random sampling (absent) would generalize, not cause. For analysis, ask: 'Did researchers assign a treatment?' (no, observational) and 'Was the sample randomly selected?' (no).

Question 8

1. Sample survey; because there was no random sample, voluntary/convenience selection may limit generalization to the whole school. (correct answer)
2. Experiment; because students answered a question, the council imposed a treatment.
3. Observational study; because students were observed entering the cafeteria, random assignment supports causation.
4. Sample survey; because 80 students were asked, the results automatically generalize to the entire school.

Explanation: Distinguishing study types—surveys, observational studies, experiments—relies on data collection methods, and randomization determines what inferences are valid, like generalization or causation. Experiments are defined by researchers assigning treatments to participants, unlike surveys that just gather information without intervention. Random sampling selects randomly from a population, supporting generalization of results to that population. Random assignment allocates to groups randomly for causal inferences. This scenario is a sample survey asking about lunch preferences without random sampling (convenience at cafeteria), so generalization to the school may be limited by bias. Commonly, people think any selection is random, but voluntary or convenience isn't random sampling and doesn't equal random assignment for causation. For classification, ask: 'Did researchers assign a treatment?' (no, survey) and 'Was the sample randomly selected?' (no, limiting generalization).

Question 9

1. Because no treatment was assigned, the study is an experiment and supports a causal conclusion about homework and grades.
2. Because the teacher asked a question, the study is observational and automatically avoids selection bias.
3. Because the question is anonymous, the sample is effectively random and results can be generalized to the whole school.
4. Because students were not randomly sampled from the school, generalizing the estimated proportion to the entire school may be questionable. (correct answer)

Explanation: Study classifications such as surveys depend on approach, with randomization crucial for unbiased generalization or causation. Experiments are marked by assigned treatments, but this involves no intervention, just questioning one class. Random sampling randomly selects from a population to support generalization. Random assignment to treatments enables causation. This sample survey lacks random sampling (only one class), so generalizing homework proportion to the school is questionable due to potential bias. A misconception is that anonymity makes sampling random, but it doesn't—random sampling generalizes, distinct from assignment for causation. To evaluate, ask: 'Did researchers assign a treatment?' (no, survey) and 'Was the sample randomly selected?' (no, limiting generalization).

Question 10

1. Randomly selecting classrooms supports a causal conclusion; randomly assigning classrooms supports generalizing to the district.
2. Because students were not individually randomized, neither generalization nor causation is possible.
3. Because the researcher used two groups, the study is a survey and can estimate the district-wide average completion time without bias.
4. Randomly selecting classrooms supports generalizing results to the district’s classrooms; randomly assigning classrooms to music vs no music supports a causal conclusion about music’s effect on completion time. (correct answer)

Explanation: Study types including experiments, surveys, and observational studies are identified by design elements, with randomization enabling specific conclusions like causation or generalization. The key feature of experiments is assigning treatments, here random assignment of classrooms to music or no music. Random sampling from a population supports generalizing results to that population, as with selecting classrooms from the district. Random assignment to groups supports causal claims by controlling for confounders. In this experiment, random sampling allows generalization to district classrooms, while random assignment enables concluding music affects completion time. A misconception is swapping the roles: sampling generalizes, assignment causes—both are correctly applied here at classroom level. To apply elsewhere, ask: 'Did researchers assign a treatment?' (yes, experiment) and 'Was the sample randomly selected?' (yes, supporting generalization).

Question 11

1. Experiment; random selection allows the counselor to conclude sleep causes better grades for all students at Central High.
2. Sample survey; random sampling supports generalizing the estimated average sleep to all students at Central High. (correct answer)
3. Observational study; random sampling supports a cause-and-effect conclusion about sleep and mood.
4. Sample survey; random sampling supports a cause-and-effect conclusion about sleep and academic performance.

Explanation: In statistics, we distinguish between types of studies—such as sample surveys, observational studies, and experiments—based on how data are collected, and randomization plays key roles in supporting generalizations or causal conclusions. Experiments are unique because researchers actively assign participants to receive different treatments or conditions. Random sampling involves selecting participants randomly from a larger population, which supports generalizing results from the sample to that population. Random assignment, on the other hand, randomly allocates participants to treatment groups, which helps establish cause-and-effect relationships by balancing out confounding factors. In this scenario, the counselor conducted a sample survey by randomly selecting students to ask about their sleep without imposing any changes, allowing generalization of the average sleep estimate to all Central High students but not causation. A common misconception is that random sampling alone enables causal claims, but it does not—it only aids generalization, unlike random assignment in experiments. To classify future studies, ask: 'Did researchers assign a treatment?' (no, so not an experiment) and 'Was the sample randomly selected?' (yes, supporting generalization).

Question 12

1. Sample survey; random assignment of seats allows generalizing to all schools in the country.
2. Observational study; because attention is rated, the study cannot involve a treatment.
3. Experiment; random assignment of seats supports a causal conclusion about seat location’s effect on attention for the students studied. (correct answer)
4. Experiment; random assignment of seats supports generalizing the results to all students everywhere.

Explanation: Differentiating experiments from other studies involves checking for randomization's role in causation or generalization. Experiments are defined by assigning treatments, like randomly assigning seats to front or back. Random sampling selects from a population for generalization. Random assignment to groups supports causal conclusions, as here with seats affecting attention. This experiment uses random assignment to claim causation for the studied students, but without random sampling, generalization beyond is limited. Commonly, people think random assignment alone generalizes widely, but it enables causation—sampling is needed for broader inferences. For future studies, ask: 'Did researchers assign a treatment?' (yes, experiment) and 'Was the sample randomly selected?' (no, not generalizing).

Question 13

1. Experiment, because water intake is a variable and variables are treatments.
2. Observational study, because the coach measures variables without assigning a hydration amount (no treatment imposed). (correct answer)
3. Sample survey, because athletes report information about themselves.
4. Experiment, because the coach compares faster and slower athletes.

Explanation: We categorize studies as surveys, observational, or experiments based on involvement, with randomization strengthening inferences on populations or causes. Experiments stand out because they involve assigning treatments, unlike this case where the coach didn't dictate water intake. Random sampling randomly chooses from a population to generalize results there. Random assignment to treatments supports causation by equalizing groups. This is an observational study recording self-chosen hydration and sprint times without imposed treatment, so no causation can be claimed. Often, people mistake measuring variables for assigning treatments, but random sampling (absent here) generalizes, not equates to assignment for causation. For identification, ask: 'Did researchers assign a treatment?' (no, observational) and 'Was the sample randomly selected?' (no, from meet attendees).

Question 14

1. Experiment; the principal can conclude tutoring causes higher grades because two groups were compared.
2. Sample survey; the principal can conclude tutoring causes higher grades because records are objective.
3. Observational study; the principal can generalize to all schools because the data come from school records.
4. Observational study; the principal cannot make a cause-and-effect conclusion because there was no random assignment to tutoring. (correct answer)

Explanation: Types of studies like observational studies, surveys, and experiments differ in design, with randomization aiding either population inferences or causal links. Experiments require researchers to assign treatments to participants, distinguishing them from observational approaches where no intervention occurs. Random sampling randomly picks from a population to support generalizing findings to that population. Random assignment randomly places participants into groups to enable cause-and-effect conclusions. In this case, the principal conducted an observational study by comparing existing groups based on voluntary tutoring without assigning it, so no causal conclusion about tutoring improving grades is possible. A frequent misconception is equating random sampling with random assignment, but only assignment supports causation—here, neither was used, preventing both. To evaluate studies, ask: 'Did researchers assign a treatment?' (no, observational) and 'Was the sample randomly selected?' (no, from records, not random).

Question 15

1. Because students were randomly assigned, the results can be generalized to all students in the district.
2. Because students were randomly assigned to groups, differences in quiz scores can be attributed to the app (causal conclusion) for this class. (correct answer)
3. Because the teacher used a control group, the study is a sample survey and can estimate the district-wide average quiz score.
4. Because the teacher measured quiz scores, the quiz itself is the treatment, so no causal conclusion is possible.

Explanation: Understanding surveys, experiments, and observational studies involves recognizing how randomization enhances inferences, either for generalization or causation. The hallmark of an experiment is that researchers impose and assign a treatment, like requiring app use versus normal study. Random sampling selects participants randomly from a population to allow results to generalize to that broader group. Random assignment divides participants into groups randomly to support causal conclusions by minimizing biases from confounders. Here, the teacher performed an experiment by randomly assigning students to app or no-app groups, enabling a causal claim that app use affects quiz scores for this class, though not generalizing beyond due to no random sampling. People often confuse random sampling with random assignment, but the former generalizes while the latter enables causation—here, assignment supports cause, not sampling for generalization. For similar studies, ask: 'Did researchers assign a treatment?' (yes, experiment) and 'Was the sample randomly selected?' (no, limiting generalization).

Question 16

1. Sample survey; random assignment allows estimating the population proportion who like instrumental music
2. Experiment; because volunteers were used, the study proves music improves recall for every student everywhere
3. Experiment; random assignment supports a causal conclusion about the effect of music on recall for these volunteers (correct answer)
4. Observational study; random assignment allows generalizing results to all students at the school

Explanation: Identifying study types requires recognizing that experiments involve researchers assigning treatments to compare their effects. Random sampling selects subjects from a population to support generalization, while random assignment allocates subjects to treatment groups to support causal conclusions about treatment effects. In this scenario, the researcher assigns volunteers to either study in silence or with music—this assignment of study conditions makes it an experiment. The random assignment ensures that any difference in recall scores can be attributed to the music condition rather than pre-existing differences between groups, supporting a causal conclusion for these 50 volunteers. However, volunteers from an after-school club aren't a random sample from any larger population, so results cannot automatically generalize beyond this specific group. The key distinction: random assignment (present here) supports causation for study participants, while random sampling (absent here) would be needed for broader generalization. Ask: Did researchers assign a treatment? Yes, making this an experiment with valid causal inference for the volunteers.

Question 17

1. Sample survey (correct answer)
2. Experiment, because sending a questionnaire is a treatment that changes preference
3. Observational study, because it measures families’ behavior without asking questions
4. Experiment

Explanation: To classify studies, we must identify whether researchers assign treatments or simply collect information. A sample survey gathers data from a subset to estimate population characteristics without manipulating variables, while experiments assign treatments. Random sampling ensures each population member has a known selection probability, supporting generalization to the whole population. Random assignment allocates treatments in experiments to enable causal conclusions. Here, the district is estimating a population proportion (families preferring email) by asking a question—they're not assigning families to prefer one method over another. Using a random sample from the complete family list means results can generalize to all district families with known sampling error. This is a classic sample survey: no treatment assignment, just measurement of an existing preference using random sampling for valid inference. The common misconception that sending a questionnaire is a 'treatment' misunderstands that treatments must attempt to change outcomes, not merely measure them.

Question 18

1. Because students were randomly assigned to tutoring type, differences in test scores can be attributed to the tutoring type (causal conclusion) for these 80 students (correct answer)
2. Because students volunteered, the study is a sample survey and can estimate the citywide mean test score
3. Because students were randomly assigned, the results automatically generalize to all algebra students in the city
4. Because there are two groups, the study proves one tutoring type is always better for every student

Explanation: This scenario illustrates the distinction between experiments and other study types based on treatment assignment. An experiment occurs when researchers assign subjects to different treatment conditions—here, the tutoring center assigns students to either online or in-person tutoring. Random sampling involves selecting subjects from a larger population using chance to support generalization to that population. Random assignment uses chance to determine which treatment each subject receives, supporting causal conclusions about treatment effects. In this study, students volunteer (not random sampling), so results don't automatically generalize beyond these 80 students. However, the random assignment of tutoring type means any difference in test scores can be attributed to the tutoring method rather than pre-existing differences between groups. The key insight is that random assignment allows causal conclusions for the subjects in the study, while random sampling would be needed to generalize to a broader population. Ask yourself: Did researchers assign a treatment? Yes, so it's an experiment with causal conclusions possible.

Question 19

1. There is no randomization because students chose whether to use the app
2. There is random assignment to treatments, which supports a causal conclusion about the app’s effect for students in this class (correct answer)
3. There is random sampling because students were chosen from one class, so the results generalize to all students in the district
4. There is random sampling and random assignment, so the results prove the app works for every high school student

Explanation: To identify the type of study, we need to recognize that experiments involve researchers assigning a treatment to subjects. In this scenario, the teacher assigns students to either use the spaced-practice app or study as usual—this assignment of treatment makes it an experiment. Random sampling refers to selecting subjects from a larger population using chance, which supports generalizing results to that population. Random assignment means using chance to determine which treatment each subject receives, which supports causal conclusions about the treatment's effect. Here, the teacher randomly assigns treatments to students in her class, but she didn't randomly sample these students from a larger population—they're just the students in her existing class. Therefore, the random assignment supports a causal conclusion about the app's effect for students in this class, but without random sampling, we cannot generalize beyond this specific class. The key insight is that random assignment and random sampling serve different purposes: assignment for causation, sampling for generalization.

Question 20

1. Experiment; lack of random assignment prevents generalizing to the whole school
2. Sample survey; because the sample is a convenience sample (not random), generalizing to the whole school may be biased (correct answer)
3. Sample survey; because she asked 60 students, the estimate must be accurate for the whole school
4. Observational study; random assignment was used so the estimate generalizes to all students

Explanation: To identify study types, we must recognize that a sample survey collects data from a subset to estimate population characteristics without assigning treatments. Random sampling gives each population member a known chance of selection, supporting unbiased generalization to the whole population. Random assignment, used in experiments, allocates treatments to support causal conclusions. In this scenario, the principal is estimating a population parameter (average homework hours) by asking students—this makes it a sample survey, not an experiment since no treatment is assigned. However, she uses convenience sampling (first 60 students she sees) rather than random sampling. This non-random selection may introduce bias because students in the cafeteria at that time might not represent all students—perhaps studious students eat quickly to return to studying, or struggling students avoid the library area. Without random sampling, generalizing to the whole school may produce biased estimates. The key question: Was the sample randomly selected? No, so generalization is questionable.