- A hospital is deciding whether to switch to a new rapid test for a contagious virus. In a study, the test correctly identified infection in 92% of infected patients and correctly ruled out infection in 95% of uninfected patients, but these rates were estimated from samples and could vary in practice. The hospital plans to use the test to decide who is isolated immediately in the emergency department. Why is it important to consider potential error?
Answer: Because sample-based estimates can differ from the true error rates, leading to false positives or false negatives that affect isolation decisions and patient outcomes
This question relates to the AP Statistics skill of introducing statistics and worrying about error, emphasizing why uncertainty in sample estimates matters for real-world decisions. In the hospital's context, the decision to isolate patients based on a rapid test involves high stakes, as false positives could unnecessarily stress resources and false negatives could spread infection. It's crucial to consider potential error because sample-based accuracy rates like 92% and 95% are estimates that may not match the true population rates due to sampling variability. A common distractor is choice B, which mistakenly claims that a large sample eliminates all error, but in reality, even large samples have variability and cannot guarantee zero error in future applications. As a mini-lesson on uncertainty, remember that all sample statistics are subject to sampling error, meaning the observed value could differ from the true parameter, and ignoring this can lead to poor decisions with serious consequences like patient harm. Thus, statistical methods like confidence intervals help quantify this uncertainty to inform better choices.
- A city health department tests a random sample of 120 restaurant workers for a contagious illness and uses the sample proportion to decide whether to require mandatory testing for all workers citywide. The policy could cost businesses thousands of dollars and missing an outbreak could harm the public. Why is it important to consider potential error when using the sample result to make this decision?
Answer: Because sampling variability means the sample proportion may differ from the true proportion, leading to a costly or unsafe policy decision
This question tests the skill of recognizing the importance of sampling error in statistical decision-making, particularly in public health policy. In the decision context, the city must weigh the costs to businesses against public safety risks, so basing the policy on a sample proportion requires caution due to potential inaccuracies. The correct answer is B, as it highlights how sampling variability can cause the sample proportion to differ from the true citywide proportion, potentially leading to harmful decisions. A common distractor is A, which incorrectly assumes that random sampling eliminates all error and guarantees exact equality between sample and population, ignoring the inherent variability in sampling. As a mini-lesson on uncertainty, remember that even with random sampling, different samples from the same population can yield varying results due to chance, known as sampling variability; this is why we must consider margins of error or confidence intervals to quantify uncertainty and make informed decisions.
- A city council uses a random sample survey to estimate support for a new tax that would fund wildfire prevention. The sample suggests a majority supports the tax, so the council plans to put it on the ballot. Why is it important to consider potential error in this inference, given that placing the measure on the ballot costs money and a failed measure could delay prevention efforts?
Answer: Because sampling variability could mean true support is below 50%, and acting on an incorrect inference could waste resources or delay needed funding
This question examines understanding of sampling error in political polling and decision-making. The city council must decide whether to place a tax measure on the ballot based on a sample survey showing majority support. Option A correctly recognizes that sampling variability means the true population support could differ from the sample estimate - if actual support is below 50%, the measure would fail, wasting ballot costs and delaying wildfire prevention efforts. Random sampling doesn't guarantee the sample estimate equals the population value (eliminating B), phone polls can still have nonresponse bias (eliminating C), option D mischaracterizes error types and when they occur, and confidence intervals quantify uncertainty but don't guarantee outcomes (eliminating E). In policy decisions with real costs and consequences, we must consider that our sample-based estimate of public support might overstate or understate true population sentiment due to random sampling variation.
- A hospital is considering adopting an AI tool that flags patients at high risk of sepsis. Administrators evaluate the tool using a study of a random sample of past patient records and plan to implement the tool if the study suggests it improves early detection. If the inference is wrong, the hospital could either miss true sepsis cases or overwhelm staff with false alarms. Why is it important to consider potential error when using the study results to decide whether to adopt the tool?
Answer: Because sample-based inference can lead to false positives or false negatives, each with different consequences for patient care
This question examines understanding of statistical error in medical decision-making contexts. The hospital must decide whether to adopt an AI sepsis detection tool based on a sample study of patient records. The correct answer recognizes that sample-based inference can produce both false positives (flagging patients who don't have sepsis) and false negatives (missing patients who do have sepsis), each with different consequences for patient care and hospital resources. The distractors incorrectly claim that significant results guarantee universal success, that random sampling eliminates error, or that legal requirements override statistical considerations. Statistical inference always involves uncertainty because we're using limited data to make broader conclusions, and in healthcare settings, both types of errors can have serious implications for patient outcomes and resource allocation.
- A bank uses a statistical model built from a sample of past borrowers to decide whether to approve small-business loans. The bank plans to tighten approval rules if the sample-based analysis suggests default risk is higher than expected in a certain sector. If the inference is wrong, the bank could deny credit to reliable businesses or approve too many risky loans. Why is it important to consider potential error when making this policy change based on the analysis?
Answer: Because uncertainty in inference means the bank could make either of two costly mistakes, so it should weigh the risks of being wrong
This question examines understanding of statistical error in financial risk assessment. The bank must decide whether to tighten loan approval rules based on a model built from sample borrower data. The correct answer recognizes that uncertainty in inference means the bank could make either of two costly mistakes - denying credit to reliable businesses or approving too many risky loans - and should weigh these risks. The distractors incorrectly claim that historical data guarantees correct predictions, that sample size thresholds eliminate error, or confuse statistical error with data entry mistakes. Statistical models built on samples inherently involve uncertainty about future outcomes. The two types of errors have different financial consequences: being too restrictive hurts creditworthy businesses and the bank's loan volume, while being too lenient increases default losses, making it essential to consider both possibilities when setting lending policies.
- A manufacturer randomly samples 50 batteries from a day's production and estimates the mean lifetime to decide whether to ship the entire batch. If the estimate is too high, customers may receive defective batteries; if too low, the company may discard good inventory. Why is it important to consider potential error when using the sample mean to make the shipping decision?
Answer: Because the sample mean can vary from sample to sample, and a wrong decision has financial and customer-safety consequences
This question evaluates understanding of why error consideration is crucial when using sample means for business decisions in manufacturing. The decision context involves balancing the risks of shipping defective batteries, which could harm customers, against unnecessarily discarding good ones, which wastes resources. The correct choice is A, emphasizing that sampling variability causes sample means to fluctuate, potentially leading to erroneous shipping decisions with real consequences. Distractor B is misleading because while the central limit theorem applies for large samples, it doesn't make the sample mean exactly equal to the population mean; variability still exists. For a mini-lesson on uncertainty, sampling error arises because a sample is only a subset of the population, so its statistics are estimates that can deviate from true values by chance; acknowledging this helps avoid overconfidence in decisions based on samples.
- A public health agency uses a random sample to estimate the proportion of restaurant kitchens that violate a new sanitation rule. The estimate is high enough that the agency considers increasing inspections, which would divert staff from other programs. Why is it important to consider potential error in the estimate when deciding whether to increase inspections?
Answer: Because the estimate could differ from the true proportion due to sampling variability, and over- or under-reacting could misallocate limited resources
This question tests understanding of estimation error in public health resource allocation. The agency must decide whether to increase restaurant inspections based on a sample estimate of violation rates. Option A correctly identifies that the sample proportion could differ from the true population proportion due to sampling variability - if the estimate is too high, resources are wasted on unnecessary inspections; if too low, violations go unchecked. Point estimates are never exact due to sampling variability (eliminating B), margin of error reflects sampling variability not bias (eliminating C), considering error remains important after data collection for decision-making (eliminating D), and confidence intervals quantify uncertainty but don't guarantee correct decisions (eliminating E). When allocating limited public health resources, agencies must recognize that sample-based estimates of violation rates are uncertain and could lead to over- or under-investment in enforcement.
- A school district samples 120 students and estimates that 18% would qualify for free tutoring under a new academic-support program. Funding decisions must be made now: if the district underestimates need, some students may go without support; if it overestimates, money may be diverted from other programs. Why is it important to consider potential error?
Answer: Because uncertainty in the estimate can lead to under- or over-allocation of resources with real consequences for students and budgets
In AP Statistics, this question highlights the importance of considering error in sample proportions, as part of introducing why we worry about statistical uncertainty in planning. The school district's funding decisions based on an 18% estimate from 120 students could lead to under-supporting students or wasting budgets if the true proportion differs. It's essential to account for potential error because sampling variability means the sample proportion might not equal the population proportion, risking real consequences for education. A distractor like choice A tempts by claiming random samples ensure exact matches, but randomness reduces bias, not variability. For a mini-lesson on uncertainty, proportions from samples fluctuate around the true value due to chance, and methods like confidence intervals quantify this range to guide more reliable decisions. Ignoring error could divert resources inefficiently, affecting students and programs.
- A pharmaceutical company runs a clinical trial on a sample of patients and finds that a new drug appears to reduce symptoms more than a placebo. Regulators must decide whether to approve the drug for widespread use. Why is it important to consider potential error in the statistical inference from the trial when making this approval decision?
Answer: Because inference from a sample is uncertain, and approving an ineffective or unsafe drug (or delaying an effective one) can have major health consequences
This question examines understanding of clinical trial error in drug approval decisions. Regulators must decide whether to approve a drug based on trial results showing apparent effectiveness. Option A correctly recognizes that inference from the trial sample is uncertain - approving an ineffective or unsafe drug (Type I error) exposes patients to risks without benefits, while rejecting an effective drug (Type II error) denies patients a helpful treatment. Randomization reduces bias but doesn't eliminate Type I error risk (eliminating B), statistical significance doesn't guarantee universal effectiveness (eliminating C), p-values measure evidence against the null not probabilities of ineffectiveness (eliminating D), and sample size requirements don't eliminate the need to consider error (eliminating E). In pharmaceutical regulation where decisions affect millions of patients, regulators must balance the risks of approving harmful drugs against denying beneficial treatments, recognizing that sample-based trial results might not reflect true drug effects.
- A bank uses a model (built from a sample of past borrowers) to predict which applicants are likely to default. Based on the model, the bank plans to automatically deny loans to applicants above a risk threshold. Denying too many loans could unfairly exclude qualified borrowers; approving too many could increase losses and raise interest rates. Why is it important to consider potential error?
Answer: Because potential misclassification (false positives and false negatives) can harm individuals or the bank, so uncertainty should be considered before making automatic decisions
Related to AP Statistics' emphasis on error in predictive models, this question shows why uncertainty in sample-based classifications matters for banking decisions. The bank's loan denial threshold, derived from past data, risks unfair exclusions or financial losses if model errors like false positives occur in new applicants. Considering potential error is crucial because the model isn't perfectly accurate, and misclassifications can harm individuals or the institution. Choice A distracts by claiming models from past data are flawless for the future, ignoring that populations change and samples vary. For a mini-lesson on uncertainty, classification errors arise from sampling variability and model assumptions, and evaluating error rates helps balance risks. This prevents over-reliance on potentially flawed predictions in sensitive areas like finance.
- An airline uses a sample of recent flights to estimate the mean delay time and decides whether to add extra scheduled buffer time. If the true mean delay is lower, adding buffer could reduce competitiveness; if the true mean delay is higher, not adding buffer could increase missed connections. Why is it important to consider potential error when using the sample estimate to make the scheduling decision?
Answer: Because sampling variability means the estimate may not match the true mean, and either decision error affects costs and customer experience
This question tests recognition of sampling variability in operational business decisions. The airline uses a sample of flights to estimate mean delay time for scheduling decisions. The correct answer (B) acknowledges that sampling variability means the sample mean might not match the true population mean - another random sample of flights could yield a different estimate. If true delays are lower than estimated, adding unnecessary buffer time reduces schedule competitiveness; if true delays are higher, insufficient buffer increases missed connections and customer dissatisfaction. Choice A incorrectly claims random sampling guarantees equality of means, while E wrongly suggests large samples eliminate uncertainty. When using statistical inference for business operations, we must remember that sample estimates contain uncertainty and both over- and under-estimation have real costs.
- A wildlife agency estimates the average number of an endangered bird species in a region using counts from 15 randomly selected observation sites. The estimate will be used to decide whether to restrict nearby construction. Restricting construction could affect jobs and housing; failing to restrict could accelerate population decline. Why is it important to consider potential error?
Answer: Because the estimate may vary due to sampling variability and measurement limits, and an incorrect inference could cause unnecessary economic harm or ecological damage
This AP Statistics question underscores worrying about error in sample means, like bird counts, and its role in environmental policy decisions. The agency's restriction on construction based on 15 sites could harm economies or ecology if the estimate doesn't match the true average due to variability or measurement issues. It's vital to consider potential error to avoid incorrect inferences with consequences like job losses or species decline. Choice A is a distractor, wrongly stating random sampling eliminates uncertainty, but it only aids representativeness, not precision. In a mini-lesson on uncertainty, sample averages fluctuate around the population mean due to chance, and confidence intervals provide a range to assess reliability. This informs balanced decisions in conservation contexts.
- A manufacturer tests a random sample of airbags from a production run and uses a hypothesis test to decide whether the defect rate exceeds the safety threshold. The test result leads the company to either recall the run or ship it. Why is it important to consider potential error when interpreting the test result, given the cost of a recall and the risk of injuries if defective airbags are shipped?
Answer: Because there is a chance of Type I or Type II error, and either kind of mistake has serious financial or safety consequences
This question tests understanding of statistical error in quality control decisions with safety implications. The manufacturer must decide whether to recall or ship airbags based on a hypothesis test using sample data. Option C correctly identifies that both Type I error (recalling safe airbags, causing unnecessary costs) and Type II error (shipping defective airbags, risking injuries) are possible and have serious consequences. The p-value is not the probability of making a wrong decision (eliminating A), large samples reduce but don't eliminate error risk (eliminating B), the null hypothesis about defect rates could be true or false in reality (eliminating D), and companies can and must make decisions based on sample inference (eliminating E). When safety and financial stakes are high, decision-makers must recognize that hypothesis tests based on samples can lead to either type of error, and both false alarms and missed defects carry significant costs.
- A water utility tests whether a new filtration method reduces the mean level of a contaminant below a regulatory threshold. Using a random sample of water tests after installation, officials will decide whether to keep the new system or revert to the old one. If the inference is wrong, residents could be exposed to unsafe water or the utility could spend money unnecessarily. Why is it important to consider potential error when using the sample results to guide this decision?
Answer: Because statistical inference involves uncertainty, and acting on an incorrect conclusion could either risk public health or waste resources
This question tests understanding of statistical error in public health and safety decisions. The water utility must decide whether to keep a new filtration system based on sample water tests. The correct answer recognizes that statistical inference involves uncertainty, and incorrect conclusions could either risk public health (if unsafe water is deemed safe) or waste resources (if safe water triggers unnecessary action). The distractors incorrectly suggest that sample results below a threshold guarantee safety, that only Type I errors matter in safety testing, or that error only affects non-numerical data. When making safety decisions from samples, we must acknowledge that our limited data might not perfectly represent all water conditions. Both false alarms and missed problems have serious consequences - one risks public health while the other wastes public resources - making it essential to consider both types of potential errors.
- A public health department estimates vaccine uptake by surveying 500 residents and finds 63% report being vaccinated. Officials are deciding whether to open additional vaccination clinics; opening too many wastes funds, but opening too few could leave vulnerable groups unprotected. Why is it important to consider potential error?
Answer: Because sampling and response errors can make the estimate differ from the true uptake, and wrong decisions can misallocate resources or increase health risk
This question in AP Statistics introduces the need to worry about error in survey estimates, such as vaccination rates, and its impact on public health planning. Officials deciding on clinic openings face resource waste or health risks if the 63% from 500 residents differs from the true uptake due to sampling or response errors. It's important to consider potential error to avoid misallocations that could endanger vulnerable groups or strain budgets. Choice A is a distractor, falsely implying large samples yield exact results, but variability persists regardless of size. In a mini-lesson on uncertainty, estimates from samples are inherently variable and can be biased by nonresponse, so tools like margins of error help quantify reliability. This ensures decisions are informed by the full picture of possible errors and their consequences.
- A public transit agency samples commute times on a bus route to decide whether to add an express bus during rush hour. If the sample suggests the mean commute time exceeds a target, the agency will reallocate drivers and buses to add service. If the inference is wrong, riders could continue to face long delays or resources could be diverted from other routes that need them more. Why is it important to consider potential error when using the sample to make this operational decision?
Answer: Because inference from a sample can lead to an incorrect conclusion, and the costs of adding unnecessary service versus failing to add needed service differ
This question tests understanding of statistical error in public transportation planning. The transit agency must decide whether to add express bus service based on sample commute time data. The correct answer recognizes that inference from a sample can lead to incorrect conclusions, with different costs for adding unnecessary service (diverting resources from other needs) versus failing to add needed service (continuing rider delays). The distractors incorrectly suggest that exceeding a target in the sample guarantees the route is too slow, that decisions require complete data, or that only measurement error matters. Sample data provides estimates about typical commute times, but sampling variability means these estimates might not perfectly represent true conditions. Understanding both potential errors helps agencies balance resource allocation: adding unneeded service wastes resources that other routes might need more, while not adding needed service perpetuates rider hardship.
- A bank uses a predictive model built from a sample of past borrowers to infer whether a new applicant is likely to default. Based on the model's output, the bank must approve or deny the loan. Why is it important to consider potential error in this inference, given the impact on both the bank's losses and the applicant's access to credit?
Answer: Because predictions based on sample data are uncertain, and false approvals or false denials both have meaningful consequences
This question examines understanding of prediction error in financial decision-making. The bank must decide whether to approve or deny a loan based on a predictive model built from historical data. Option C correctly recognizes that predictions based on sample data are inherently uncertain - the model might incorrectly predict default (leading to denied credit for creditworthy applicants) or incorrectly predict repayment (leading to losses from defaults). Model predictions are probabilistic, not guarantees (eliminating A), Type I error isn't the only concern and doesn't occur with every approval (eliminating B), historical data doesn't eliminate prediction error for new cases (eliminating D), and adding variables doesn't remove all uncertainty (eliminating E). In lending decisions affecting both bank risk and individual access to credit, decision-makers must acknowledge that statistical models produce uncertain predictions that can result in both false positives and false negatives.
- An online retailer runs an A/B test on a sample of site visitors to see whether a new checkout design increases the proportion of completed purchases. Leaders will roll out the design if the test suggests an improvement. If the inference is wrong, the company could lose revenue by rolling out a harmful design or miss revenue by not adopting a beneficial one. Why is it important to consider potential error when making the rollout decision based on this test?
Answer: Because the decision uses sample evidence, and both false alarms and missed improvements are possible and costly
This question examines understanding of statistical error in business A/B testing contexts. The retailer must decide whether to roll out a new checkout design based on test results from a sample of visitors. The correct answer recognizes that sample evidence can lead to both false alarms (concluding improvement when none exists) and missed improvements, both of which are costly in terms of lost revenue. The distractors incorrectly claim that A/B tests provide certainty, that large samples eliminate uncertainty, or that only one type of error is possible. Even well-designed A/B tests use samples of visitors to infer about all future visitors, introducing uncertainty. The business consequences differ between the two errors: rolling out a harmful design could decrease revenue, while not adopting a beneficial design means missing potential gains, making it important to consider both possibilities when interpreting test results.
- A city considers changing a traffic-light timing plan after a sample of 40 weekday mornings shows the average commute time on a major corridor decreased by 2.5 minutes with the new plan. The transportation director wants to implement the change citywide, but longer commutes could increase accident risk and delay emergency vehicles. Why is it important to consider potential error?
Answer: Because the observed decrease could be due to sampling variability, and being wrong could worsen commutes and safety outcomes
This question addresses the AP Statistics concept of worrying about error in estimates, particularly how sampling variability affects inferences from data like average commute times. The city's decision to implement a new traffic plan citywide carries risks, such as increased accidents if commutes actually worsen despite the sample showing a decrease. Considering potential error is vital because the 2.5-minute drop in the sample of 40 mornings might result from random chance rather than a true improvement. Choice A is a distractor that appeals by suggesting samples guarantee population outcomes, but this ignores that samples provide estimates, not certainties. In a mini-lesson on uncertainty, sampling error arises because different samples from the same population can yield varying results, and without accounting for this, decisions could lead to negative outcomes like safety hazards. Statistical tools like hypothesis tests can assess whether observed changes are likely due to chance or real effects.
- A tech company A/B tests a new app interface on a sample of users and observes a higher purchase rate in the new version. The company plans to roll out the change globally, but if the true effect is smaller or negative, revenue could drop and users could be frustrated. Why is it important to consider potential error?
Answer: Because the observed difference could be due to random variation, and acting as if the sample result is guaranteed could lead to costly rollout mistakes
In AP Statistics, this question introduces error concerns in A/B testing, highlighting uncertainty's impact on product rollout decisions. The company's global implementation based on higher sample purchase rates risks revenue drops or user frustration if the difference is due to random variation, not a true improvement. Considering potential error is essential to prevent costly mistakes from treating sample results as guarantees. Choice A distracts by suggesting sample superiority ensures universal benefits, but variability means results may not generalize. As a mini-lesson on uncertainty, experimental differences can stem from chance, and hypothesis testing evaluates if they're statistically significant. This approach safeguards against erroneous conclusions in business.
