College Statistics Quiz: Random Assignment And Causation

20 questions · exam conditions

0:00

Random Assignment And CausationQuestion 1 of 20

To investigate a new weight-loss supplement, a researcher recruits 80 volunteers from a local gym. The researcher then randomly assigns 40 volunteers to take the supplement and 40 to take a placebo for 10 weeks. The supplement group loses significantly more weight.

What is the most accurate statement regarding the scope of inference for this experiment?

A causal relationship between the supplement and weight loss can be inferred for the 80 volunteers, but this result may not generalize to the wider population.

A causal relationship can be inferred and generalized to the entire population because the sample size is sufficiently large.

An association between the supplement and weight loss can be inferred for the 80 volunteers, but a causal link cannot be established.

Neither a causal link nor a generalization is possible because the volunteers were not randomly selected from the population.

← Back to quizzes

College Statistics Quiz

College Statistics Quiz: Random Assignment And Causation

Practice Random Assignment And Causation in College Statistics with focused quiz questions that help you check what you know, review explanations, and build confidence with test-style prompts.

What this quiz covers

This quiz focuses on Random Assignment And Causation, giving you a quick way to practice the rules, question types, and explanations that matter most for College Statistics.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

All questions

Question 1

What is the most accurate statement regarding the scope of inference for this experiment?

A causal relationship between the supplement and weight loss can be inferred for the 80 volunteers, but this result may not generalize to the wider population. (correct answer)
A causal relationship can be inferred and generalized to the entire population because the sample size is sufficiently large.
An association between the supplement and weight loss can be inferred for the 80 volunteers, but a causal link cannot be established.
Neither a causal link nor a generalization is possible because the volunteers were not randomly selected from the population.

Explanation: Because the researcher used random assignment, a causal conclusion about the effect of the supplement is justified for the people in the study. However, the participants were volunteers from a specific local gym, not a random sample from a broader population. Therefore, we cannot confidently generalize the results to people who are not like these volunteers (e.g., people who don't go to a gym).

Question 2

A professor teaches two large sections of the same statistics course, one at 8:00 AM and one at 1:00 PM. To test the effectiveness of a new teaching activity, she randomly decides to use the new activity in the 1:00 PM section while the 8:00 AM section serves as a control. She finds that the 1:00 PM section has significantly higher scores on the final exam.

What is the most critical flaw in the professor's claim that the new activity caused the higher scores?

The experimental units (individual students) were not randomly assigned to the treatments; entire classes were assigned. (correct answer)
The professor was not blinded to the treatment, which may have caused her to grade the 1:00 PM section more leniently.
The sample size of two sections is too small to draw a meaningful conclusion about the teaching activity.
The study should have included a third section with no teaching activity at all for a proper baseline.

Explanation: The unit of randomization should be the same as the unit of analysis (the student). By assigning the treatment to an entire class section, any systematic differences between the students who choose to enroll in an 8:00 AM class versus a 1:00 PM class (e.g., motivation, work schedules, sleep habits) are completely confounded with the treatment. This is a quasi-experiment, and the failure to randomize individual students is its most significant threat to establishing causality.

Question 3

A researcher is planning an experiment to test if a new type of ergonomic chair reduces back pain in office workers. There are 100 volunteers for the study. The researcher suspects that the effect of the chair might be different for employees under age 40 compared to those 40 and over.

To establish a causal link while accounting for the potential effect of age, which is the most appropriate and powerful study design?

Randomly assign 50 volunteers to the ergonomic chair and 50 to a standard chair, then analyze the results for the two age groups separately.
First, separate the volunteers into two blocks: under 40 and 40-and-over. Then, within each block, randomly assign half of the volunteers to the ergonomic chair and half to the standard chair. (correct answer)
Allow the volunteers to choose which chair they would prefer to use, but ensure that an equal number of people from each age group end up in each chair type.
Assign all volunteers under 40 to the ergonomic chair and all those 40 and over to the standard chair to directly measure the effect of age.

Explanation: This describes a randomized block design. By blocking on age, the researcher ensures that the age variable is controlled for and that there is a balanced comparison between the chairs within each age group. Random assignment is still the key element that allows for causal inference within each block. Option A is a completely randomized design, which is valid but less powerful if age is indeed a strong factor. Options C and D are not experiments that use random assignment and would not support causal conclusions.

Question 4

An experiment was designed to test the efficacy of a new intensive coaching program for a standardized exam. 400 students were recruited and randomly assigned to either the new program or a standard-materials control group. The program lasted for eight weeks. However, the new program was extremely demanding, and 50% of its participants dropped out before completion. In the control group, only 5% dropped out. Among those who completed the study, the new program group scored significantly higher on the exam.

Which of the following represents the most significant threat to the validity of a causal claim that the new program is superior?

The initial random assignment failed to create comparable groups because it did not account for students' baseline academic abilities.
A control group using standard materials is not a true control; a no-study group should have been included for a valid comparison.
The high and differential dropout rate likely means the remaining participants in the groups are no longer comparable, creating a form of selection bias. (correct answer)
The placebo effect is a major concern, as participants in the new program likely expected to perform better simply because the program was new.

Explanation: High and differential attrition (dropout) can destroy the benefits of initial random assignment. The students who remained in the demanding program might have been more motivated, more resilient, or had higher baseline ability than those who dropped out. Because so few dropped out of the control group, the final groups are likely no longer comparable on these key characteristics. This introduces a significant confounding variable, making it impossible to attribute the score difference solely to the program itself.

Question 5

When analyzing data from a well-designed, completely randomized experiment, a statistically significant result (e.g., a small p-value) indicates that...

...the difference observed between the treatment groups is large and practically important.
...it is unlikely that the observed difference between groups occurred simply due to the chance involved in the random assignment. (correct answer)
...the random assignment was successful in creating groups that were perfectly identical before the treatment was applied.
...the results can be confidently generalized to the entire population from which the experimental subjects were drawn.

Explanation: Statistical significance in the context of a randomized experiment addresses the question of whether random chance is a plausible explanation for the observed results. A small p-value suggests that the observed difference is larger than what we would expect to see just from the 'luck of the draw' in the random assignment process. It allows us to rule out chance as a likely explanation, thereby strengthening the causal inference that the treatment caused the difference. It does not, by itself, speak to the size of the effect (A), the perfection of the randomization (C), or generalizability (D).

Question 6

A researcher states that random assignment makes treatment groups "equivalent in expectation." Which of the following best captures the meaning of this phrase?

For any given experiment, the sample means of any pre-treatment characteristic (like age or weight) will be exactly equal across the groups.
If the experiment were hypothetically repeated an infinite number of times, the average of the group means for any pre-treatment characteristic would be identical. (correct answer)
The participants in all groups are expected to have the same outcome on the response variable.
The researcher expects that the random assignment procedure will be successful in eliminating all differences between the groups.

Explanation: The term "in expectation" or "on average" refers to the long-run average over many repetitions of the random assignment process. It does not mean that groups will be perfectly balanced in any single experiment (Option A). It means that the assignment process is unbiased, and if repeated, the average value of any characteristic across the groups would converge to the same number. This property is what allows us to use probability theory to make inferences.

Question 7

A research paper's conclusion states, "Our study provides strong evidence that daily consumption of at least 30 grams of fiber from whole grains causes a decrease in systolic blood pressure in adults."

For this causal conclusion to be justified by the study design, which of the following methodologies must have been used?

A large, random sample of adults was surveyed, and their daily fiber intake and blood pressure were measured and found to be negatively correlated.
A sample of adults was recruited, and participants were randomly assigned to either a diet with at least 30 grams of fiber or a control diet with lower fiber content. (correct answer)
A group of adults with high blood pressure was compared to a group with normal blood pressure, and their dietary habits were retrospectively analyzed.
A group of adults volunteered to follow a high-fiber diet for three months, and their blood pressure was found to be significantly lower at the end of the period.

Explanation: A strong causal claim requires an experimental design. The key feature of such a design is the random assignment of participants to different treatment levels (in this case, different diets). The other options describe observational studies (A and C) or a pre-test/post-test study with no control group (D), none of which are sufficient to establish causation because they do not control for confounding variables.

Question 8

A research team conducted a study to examine the effects of a new cognitive training program on memory. They obtained a list of all 2,000 first-year students at a large university and randomly selected 200 to participate. These 200 students were then randomly assigned to one of two groups: one group completed the cognitive training program, and the control group watched documentaries for the same amount of time. The training group showed significantly better memory test results.

Based on the design of this study, which of the following is the most appropriate conclusion?

There is evidence of an association, but not necessarily a causal link, between the training and improved memory for all first-year students at this university.
There is evidence that the training program causes improved memory, and this conclusion can be generalized to all university students.
There is evidence that the training program causes improved memory for first-year students at this university. (correct answer)
There is evidence of an association between the training and improved memory, but the conclusion cannot be generalized beyond the 200 students who participated.

Explanation: This study used both random sampling (selecting 200 students from a list of all first-years) and random assignment (placing those 200 into treatment or control groups). Random assignment allows for making a causal conclusion. Random sampling allows for generalizing the results to the population from which the sample was drawn (all first-year students at that university). Therefore, the strongest valid conclusion combines both causation and generalization to the correct population.

Question 9

In an experiment with a small sample of 30 participants, a researcher randomly assigns 15 participants to a treatment group and 15 to a control group. After the assignment, she notices a chance imbalance: the treatment group contains 12 participants who exercise regularly, while the control group contains only 4. The treatment group shows a much better outcome.

Given this observed imbalance after a correctly performed random assignment, which statement is the most statistically sound?

The random assignment process has failed and the study should be discarded and re-randomized until the groups are balanced on exercise.
Because random assignment was used, the researcher can confidently conclude the treatment caused the outcome, as the process controls for all confounding variables.
The study is fundamentally flawed and has become an observational study because the groups are no longer comparable with respect to exercise.
The process of randomization does not guarantee balance in small samples; the confounding effect of exercise should be addressed in the statistical analysis (e.g., using ANCOVA). (correct answer)

Explanation: Random assignment is a probabilistic process. While it tends to create balanced groups on average, especially in large samples, it does not guarantee balance in any single experiment, particularly a small one. The randomization was performed correctly, so it is still an experiment. However, the observed imbalance on a key potential confounder (exercise) must be acknowledged and accounted for in the analysis to make a valid causal inference.

Question 10

To investigate if listening to classical music improves concentration, a researcher randomly assigns 100 student volunteers into two groups. Group A works on a logic puzzle in a silent room. Group B works on the same puzzle in a room with classical music playing. Group B performs significantly better. The researcher concludes the music causes the improvement. However, a critic suggests the music may have improved performance simply by making participants feel more relaxed.

In this context, the participants' level of relaxation is best described as which type of variable?

A confounding variable that invalidates the random assignment because it was not evenly distributed between the groups.
A mediating variable that helps to explain the causal pathway through which the music affects puzzle performance. (correct answer)
An independent variable that was manipulated by the researcher along with the presence of music.
A blocking variable that should have been measured and used to group participants before the experiment began.

Explanation: A confounding variable is a third variable associated with both the treatment and the outcome that provides an alternative explanation. Random assignment controls for pre-existing confounders. A mediating variable is different; it is part of the causal chain. Here, the proposed mechanism is Music -> Relaxation -> Improved Performance. Relaxation is on the causal pathway, not an external confounder. Random assignment doesn't control for mediators; it allows us to study the overall causal effect, which might operate through a mediator.

Question 11

In many fields, a randomized controlled trial is considered the "gold standard" for establishing a causal relationship. What is the unique advantage of random assignment over other study designs, like a meticulously matched-pairs observational study?

Random assignment ensures the results from the sample can be generalized to a broader population.
Random assignment is the only design that allows for the use of statistical hypothesis testing.
Random assignment tends to balance the treatment groups on both known and, crucially, unknown potential confounding variables. (correct answer)
Random assignment eliminates random variation in the results, ensuring any observed difference is the true effect.

Explanation: While observational studies can try to control for known confounding variables through methods like matching, they cannot control for unknown or unmeasured confounders. The unique power of random assignment is that, by using chance, it tends to create groups that are balanced on all variables, whether the researchers have thought of them or not. This is why it provides much stronger evidence for causation.

Question 12

A study is conducted on the effect of a new medication for migraines. 150 volunteers are randomly assigned to a medication group or a placebo group. The study is "double-blind."

What is the combined effect of using both random assignment and a double-blind procedure in this study?

Random assignment creates comparable groups, while double-blinding ensures that the results can be generalized to the entire population.
Random assignment controls for bias in selecting participants, while double-blinding controls for bias in the measurement of outcomes.
Random assignment controls for confounding variables, while double-blinding reduces potential bias from the expectations of participants and researchers. (correct answer)
Random assignment ensures the study has enough statistical power, while double-blinding is the process that allows for a causal conclusion.

Explanation: Random assignment and double-blinding are two distinct procedures that address different potential flaws in an experiment. Random assignment is used to create comparable groups at the start of the study to control for confounding variables. Double-blinding is used during the study to prevent the beliefs and expectations of participants (placebo effect) and researchers (observer bias) from influencing the results. Both strengthen the validity of the causal conclusion.

Question 13

A study aims to determine the causal effect of regular exercise on sleep quality. Which of the following is a primary reason that researchers would use an experiment with random assignment rather than an observational study to investigate this question?

It is easier and less expensive to recruit participants for an experiment than for a large-scale observational study.
An experiment can ethically assign participants to potentially beneficial behaviors like exercise, which an observational study cannot.
An observational study cannot measure sleep quality with the same precision as an experiment.
People who choose to exercise may also have other healthy habits (e.g., better diet, less stress) that affect sleep; random assignment can control for these confounding factors. (correct answer)

Explanation: When you encounter questions about establishing causation, the key distinction is between experiments and observational studies. Experiments use random assignment to create comparable groups, while observational studies simply observe existing differences between people who already engage in different behaviors. The correct answer is D because confounding variables are the primary threat to causal inference in observational studies. People who exercise regularly likely differ from non-exercisers in many ways beyond just their exercise habits—they may eat healthier, manage stress better, have different work schedules, or possess personality traits that affect sleep. In an observational study, you can't separate the effect of exercise from these other factors. Random assignment solves this by distributing these confounding characteristics roughly equally between the exercise and control groups, isolating exercise as the variable of interest. Looking at the incorrect options: A is wrong because experiments are typically more expensive and logistically complex than observational studies due to the need to control conditions and randomly assign treatments. B misses the point—both study types can ethically investigate beneficial behaviors, and ethics isn't the primary methodological consideration here. C is incorrect because measurement precision depends on the instruments used, not the study design; observational studies can measure sleep quality just as accurately as experiments. Remember this pattern: when a question asks why experiments are preferred over observational studies for causal inference, look for the answer that addresses confounding variables or random assignment. The core advantage of experiments is their ability to control for unmeasured differences between groups.

Question 14

In a clinical trial for a new antidepressant, 300 patients are randomly assigned to one of three groups: Group 1 receives the new drug, Group 2 receives a standard, existing drug, and Group 3 receives a placebo. All pills are identical in appearance.

What is the specific inferential purpose of including Group 2 (the standard drug) in the experimental design?

It provides a direct comparison to determine if the new drug is not just effective, but more effective than the current treatment standard. (correct answer)
It is necessary to create three groups so that the process of random assignment is statistically valid.
It allows researchers to determine if the new drug's effect is greater than the psychological effect of taking any pill.
It helps to balance the potential confounding variables across a larger number of groups, strengthening the study's overall causal claim.

Explanation: When analyzing experimental designs, you need to understand the specific purpose each control group serves in making valid statistical inferences. This three-group design includes both an active control (standard drug) and a passive control (placebo) for distinct inferential reasons. Group 2 (the standard drug) serves as an active control that allows researchers to determine not just whether the new drug works, but whether it works better than existing treatments. This addresses the clinically relevant question: "Should we switch from our current treatment to this new one?" Simply showing that a new drug beats a placebo doesn't answer this question—you need direct comparison to the current standard of care to establish superior efficacy. Let's examine why the other options miss the mark: Option B is incorrect because random assignment works perfectly well with any number of groups—you don't need exactly three groups for statistical validity. Option C confuses the roles of the control groups. The placebo (Group 3), not the standard drug, controls for psychological effects and allows comparison against the "pill effect." Option D misunderstands experimental control. While having more groups can provide additional information, the primary purpose of the standard drug group isn't to balance confounding variables—randomization already handles that. Study tip: In clinical trial questions, always ask yourself what specific comparison each control group enables. Active controls (existing treatments) test superiority, while passive controls (placebos) test basic efficacy. Understanding this distinction will help you identify the inferential purpose of different experimental groups.

Question 15

To implement random assignment of 200 subjects to two groups (Treatment and Control) of 100 each, a researcher proposes the following method: "Assign the first 100 subjects who volunteer for the study to the Treatment group, and the next 100 who volunteer to the Control group." What is the primary statistical weakness of this assignment procedure?

The group sizes are equal, which reduces the statistical power of the experiment compared to having unequal group sizes.
The procedure is not truly random; systematic differences between early and late volunteers are confounded with the treatment. (correct answer)
This method makes it impossible to double-blind the study, as subjects will know if they arrived early or late.
This procedure is a form of random sampling, not random assignment, so results cannot be used to infer causation.

Explanation: This is not a random assignment procedure. The time at which a person volunteers could be related to many factors (e.g., enthusiasm, work schedule, proximity to the lab), which could also be related to the outcome. By assigning groups based on arrival order, these factors become confounding variables. A proper random assignment would give every individual, regardless of when they volunteered, an equal chance of being in either group (e.g., by flipping a coin for each person).

Question 16

A pharmaceutical company develops a new drug to lower cholesterol. To test its effectiveness, they recruit 200 volunteers with high cholesterol. A researcher uses a computer to randomly sort the volunteers into two groups of 100. Group A receives the new drug for 12 weeks, and Group B receives a visually identical placebo pill. At the end of the study, the average cholesterol reduction in Group A is significantly greater than in Group B.

What is the primary reason that the random assignment of volunteers to groups strengthens the conclusion that the new drug caused the reduction in cholesterol?

It ensures that the sample of 200 volunteers is representative of the entire population of people with high cholesterol.
It minimizes the potential for pre-existing differences between the two groups, such as diet or exercise habits, to be a confounding explanation for the results. (correct answer)
It guarantees that the only difference between the two groups of volunteers is the treatment they received, eliminating all other sources of variation.
It removes the need for a placebo, as the randomization process itself accounts for any psychological effects of treatment.

Explanation: The primary benefit of random assignment is to create groups that are approximately equivalent on average before treatment is administered. This balances the influence of potential confounding variables (both known and unknown), making it reasonable to attribute significant post-treatment differences in the outcome to the treatment itself.

Question 17

Given this observed imbalance after a correctly performed random assignment, which statement is the most statistically sound?

The random assignment process has failed and the study should be discarded and re-randomized until the groups are balanced on exercise.
Because random assignment was used, the researcher can confidently conclude the treatment caused the outcome, as the process controls for all confounding variables.
The study is fundamentally flawed and has become an observational study because the groups are no longer comparable with respect to exercise.
The process of randomization does not guarantee balance in small samples; the confounding effect of exercise should be addressed in the statistical analysis (e.g., using ANCOVA). (correct answer)

Question 18

Random assignment ensures the results from the sample can be generalized to a broader population.
Random assignment is the only design that allows for the use of statistical hypothesis testing.
Random assignment tends to balance the treatment groups on both known and, crucially, unknown potential confounding variables. (correct answer)
Random assignment eliminates random variation in the results, ensuring any observed difference is the true effect.

Question 19

It is easier and less expensive to recruit participants for an experiment than for a large-scale observational study.
An experiment can ethically assign participants to potentially beneficial behaviors like exercise, which an observational study cannot.
An observational study cannot measure sleep quality with the same precision as an experiment.
People who choose to exercise may also have other healthy habits (e.g., better diet, less stress) that affect sleep; random assignment can control for these confounding factors. (correct answer)

Question 20

Under which of the following circumstances would establishing a causal link via a randomized controlled trial be most challenging or inappropriate?

When determining if a specific pollutant in drinking water increases the risk of a rare form of cancer over a 25-year period. (correct answer)
When studying the effect of a new font on reading speed for a group of student volunteers.
When investigating whether a new vaccine prevents a common infectious disease.
When comparing the effectiveness of two different advertising campaigns on sales for a company's product.

Explanation: When evaluating the feasibility of randomized controlled trials, you need to consider three key factors: ethical constraints, practical limitations, and time requirements. Some research questions simply cannot be answered through controlled experiments due to these barriers. Option A presents multiple insurmountable challenges that make a randomized trial inappropriate. First, it would be deeply unethical to deliberately expose people to a potentially cancer-causing pollutant just to establish causation. Second, studying a rare cancer would require an enormous sample size to detect meaningful differences. Third, the 25-year timeframe makes the study practically impossible to complete within reasonable research timelines. For such scenarios, researchers must rely on observational studies like cohort studies or case-control designs. Options B, C, and D all represent feasible randomized trials. Option B involves a harmless intervention (font changes) with immediate, measurable outcomes. Option C describes a standard vaccine trial where participants can be randomly assigned to receive either the vaccine or a placebo, with clear ethical justification since the goal is protecting health. Option D represents a straightforward business experiment where customers can be randomly exposed to different advertising approaches without harm. The key distinction is that options B, C, and D involve interventions that are either beneficial or neutral, can be ethically administered, and have reasonable timelines for measuring outcomes. Study tip: When evaluating research design questions, always ask yourself: "Is this ethical, practical, and measurable within a reasonable timeframe?" If any answer is no, a randomized trial likely isn't appropriate.