- A wildlife agency investigates the research question: "What is the mean weight of adult trout in Lake Orion?" Biologists used nets at two easily accessible shoreline locations on a single afternoon and weighed 60 adult trout; the sample mean weight was 1.8 kg. They concluded that the mean weight of adult trout in Lake Orion is about 1.8 kg. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the fish were caught at only two accessible shoreline locations and one time, so the sample may not represent all adult trout in the lake.
This question demonstrates how convenience sampling based on accessibility can create biased samples in ecological research. The biologists sampled trout from only two easily accessible shoreline locations on a single afternoon, which likely doesn't represent the full population of adult trout in Lake Orion. Fish at different depths, in different parts of the lake, or active at different times may have different weights due to varying food availability, water temperature, or habitat quality. Shoreline fish might be smaller or larger than those in deeper waters. Additionally, sampling on just one afternoon doesn't account for temporal variation. The 1.8 kg mean weight estimate is questionable because the sampling method systematically excludes trout from most of the lake. Valid conclusions would require sampling from multiple locations throughout the lake across different times.
- A health clinic investigates: What is the average systolic blood pressure of adults (ages 18+) in the county? The population is all adults in the county. The clinic sampled 150 adults by measuring blood pressure of the first 150 patients who came to the clinic in January. The sample mean was 132 mmHg, and the clinic concludes the county's adult mean systolic blood pressure is 132 mmHg. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because a convenience sample of clinic patients may not represent all adults in the county.
This question illustrates classic convenience sampling bias in health research. The clinic sampled only patients who visited in January, creating a biased sample that likely overrepresents people with health concerns serious enough to seek medical care. Choice A correctly identifies that clinic patients are not representative of all county adults - they probably include more people with health issues, potentially including hypertension, compared to the general population. The sample size of 150 is reasonable for estimating a mean, and measuring blood pressure doesn't significantly affect the reading in a way that would invalidate results. Random distribution of patients geographically doesn't make them representative of all adults. To validly estimate county-wide blood pressure levels, researchers need a random sample from the entire adult population, not just those seeking medical care.
- A university investigates the research question: "Do first-year students at the university spend more time studying on weekends than on weekdays?" Researchers recruited 40 volunteers from an honors study-skills workshop and had them self-report hours studied on a typical weekday and a typical weekend day; the volunteers reported more hours on weekends. The researchers concluded that first-year students at the university generally study more on weekends than weekdays. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the participants were volunteers from an honors workshop, so the sample may not represent all first-year students.
This question highlights how volunteer samples from specific subgroups cannot support generalizations to larger populations. The researchers recruited volunteers from an honors study-skills workshop, creating a sample that likely overrepresents academically motivated students who actively seek study improvement resources. These students probably have different study habits than typical first-year students, making any conclusions about weekend versus weekday study time invalid for the general first-year population. Additionally, self-selection bias occurs when students choose to participate, further skewing the sample toward those interested in the research topic. To validly answer their research question, researchers would need to randomly sample from all first-year students, not just workshop attendees, and address potential nonresponse issues.
- A streaming service wants to estimate the proportion of its subscribers who would recommend the service to a friend. It used a random number generator to select 1200 subscriber accounts from its full subscriber list and emailed those accounts a survey; 840 responded, and 72% of respondents said they would recommend the service. The company concluded that "about 72% of all subscribers would recommend the service." Which statement explains whether the conclusion is valid?
Answer: The conclusion may not be valid because only 840 of the randomly selected subscribers responded; if responders differ from nonresponders, nonresponse bias could affect the estimate.
This AP Statistics question evaluates nonresponse bias in random samples, stressing how incomplete responses affect the truthfulness of data conclusions. Although accounts were randomly selected, only 840 of 1200 responded, and if nonresponders differ (e.g., less satisfied subscribers ignore emails), the results could be biased. Choice A is a distractor suggesting randomness eliminates nonresponse bias, but bias can still occur if responders aren't representative. For trustworthy conclusions, high response rates or follow-ups are needed to mitigate nonresponse, ensuring the responding sample reflects the selected one. The conclusion may not be valid without addressing this, providing a lesson that even random starts require complete data to avoid distortion.
- A state agency wants to estimate the proportion of registered voters in the state who approve of a proposed ballot measure. The agency used a list of landline telephone numbers and called numbers at random until 600 registered voters responded; 49% approved. The agency concluded that "about 49% of registered voters in the state approve of the measure." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because using only landline numbers may undercoverage certain groups of voters, so the sample may not represent all registered voters.
This AP Statistics question examines undercoverage bias in sampling frames, particularly with outdated methods like landline surveys, and how it affects the truth of conclusions. The issue is that using only landline numbers excludes cell-phone-only households, which may include younger or mobile voters with different opinions, leading to a non-representative sample of registered voters. Choice C distracts by claiming random calling ensures equal chance, but this overlooks undercoverage if the list misses parts of the population. To ensure trustworthy conclusions, the sampling frame must cover the entire population adequately, using methods like mixed-mode surveys to reach all groups. The conclusion here is invalid due to potential undercoverage, teaching that biases from incomplete frames can distort estimates and must be addressed for accurate results.
- A state wildlife agency investigates the research question: "What proportion of households in the state support increasing funding for state parks?" The population is all households in the state. The agency uses a random-digit-dialing method to call landline phone numbers and interviews 600 households; 62% say they support increased funding. The agency concludes that 62% of all households in the state support increased funding. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because using only landlines may underrepresent households without landlines and bias the estimate.
This question addresses coverage bias in telephone surveys. The agency used only landline phones, which excludes households that rely exclusively on cell phones - a growing segment of the population. The correct answer A identifies this coverage problem: households without landlines may have different characteristics (younger, lower income, more mobile) that correlate with their support for park funding. This systematic exclusion of part of the population means the sample cannot represent all households in the state. Modern survey methodology recognizes that landline-only samples are increasingly problematic as more households abandon landlines. To obtain trustworthy estimates, surveys must include both landline and cell phone numbers to ensure adequate coverage of the target population.
- A city's transportation office wants to know whether most adult residents support adding protected bike lanes downtown. Staff members stood outside a Saturday afternoon bike festival and asked 250 adults who walked by, "Do you support adding protected bike lanes downtown?" About 78% said yes. The office concluded that "about 78% of all adult residents in the city support adding protected bike lanes." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the sample was a convenience sample from a bike festival and likely overrepresents people who favor bike lanes.
This question tests the skill of identifying sampling bias in data collection methods, specifically convenience sampling, as part of understanding how collected data can tell the truth in AP Statistics. The data collection issue here is that the survey was conducted at a bike festival using a convenience sample of passersby, which likely includes a higher proportion of bike enthusiasts who support bike lanes, leading to an overestimation of citywide support. A common distractor is choice A, which incorrectly assumes that a large sample size alone ensures representativeness, ignoring the bias introduced by the non-random selection method. To draw trustworthy conclusions from survey data, it's essential to use random sampling techniques that give every member of the population an equal chance of being selected, thereby minimizing bias and allowing generalization to the entire population. In this case, the conclusion is invalid because the sample does not represent all adult residents, highlighting the importance of evaluating the sampling frame and method before accepting results.
- A company investigates the research question: "What proportion of employees at the company are satisfied with their health insurance?" The HR department took an alphabetized list of all employees and surveyed every 10th person starting with the 7th name; 210 employees were selected and 196 responded, and 72% of respondents said they were satisfied. HR concluded that about 72% of all employees are satisfied with their health insurance. Which statement explains whether the conclusion is valid?
Answer: The conclusion is valid because a systematic sample from a complete employee list can be representative if there is no pattern related to satisfaction in the ordering.
This question tests understanding of systematic sampling and its potential validity. The HR department used systematic sampling (every 10th person from an alphabetized list), which can produce representative samples if the list ordering is unrelated to the characteristic being measured. Since alphabetical order of names is unlikely to correlate with health insurance satisfaction, this method should yield results similar to simple random sampling. The high response rate (196/210 = 93%) minimizes nonresponse bias concerns. The conclusion that 72% of employees are satisfied appears valid, assuming the employee list was complete and current. Systematic sampling is often more practical than simple random sampling while maintaining statistical validity, making it appropriate for this internal company survey.
- A company investigates the research question: "What proportion of all customers who bought a laptop in the last year are satisfied with their purchase?" The population is all customers who bought a laptop in the last year. The company randomly selects 400 customers from its purchase database and emails them a satisfaction survey; 180 respond, and 85% of those respondents report being satisfied. The company concludes that 85% of all laptop buyers are satisfied. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because only 180 of the 400 selected responded, and nonresponse bias may affect the estimate.
This question demonstrates nonresponse bias in survey research. Although the company started with a random sample of 400 customers, only 180 responded (45% response rate). The correct answer B recognizes that nonresponse bias threatens the validity of the conclusion because satisfied customers might be more likely to respond than dissatisfied ones. When a large portion of the selected sample doesn't respond, the respondents may systematically differ from non-respondents in ways related to the variable being measured (satisfaction). The 85% satisfaction rate among respondents likely overestimates the true satisfaction rate among all laptop buyers. To draw trustworthy conclusions, researchers must either achieve high response rates or investigate whether respondents and non-respondents differ systematically.
- A restaurant chain investigates the research question: "What is the mean satisfaction rating among all customers who ate at our restaurants last month?" The chain printed a QR code on receipts inviting customers to rate their experience; 1,860 customers responded, with a mean rating of 4.6 out of 5. The chain concluded that the mean satisfaction rating for all customers last month was about 4.6. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the QR code creates a voluntary response sample, and people with strong opinions may be more likely to respond.
This question examines voluntary response bias in customer satisfaction surveys, a common issue in business research. By printing QR codes on receipts and relying on customers to voluntarily scan and respond, the restaurant creates a sample biased toward customers with strong opinions (either very satisfied or very dissatisfied). Moderately satisfied customers are less motivated to take time to complete surveys, leading to overrepresentation of extreme views. The large sample size (1,860) doesn't correct this fundamental bias in who chooses to respond. The 4.6 average likely overestimates true satisfaction if happy customers are more motivated to share positive experiences. For valid conclusions, the restaurant would need to randomly select customers and actively solicit their feedback, perhaps offering incentives to increase response rates across all satisfaction levels.
- A health clinic wants to estimate the proportion of adults in its county who received a flu shot this season. A nurse sampled 300 patients who came to the clinic during a two-day period and found that 64% reported receiving a flu shot. The clinic concluded that "about 64% of adults in the county received a flu shot this season." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the sample consists of clinic visitors and may not represent all adults in the county (selection bias).
Identifying selection bias in convenience samples is the focus of this AP Statistics question, exploring how data collection methods reveal or distort the truth. The clinic sampled only visitors, who may be more health-conscious and likely to get flu shots, creating a biased group that doesn't represent all county adults. Choice A distracts by claiming clinic patients are random, but they are self-selected and may differ systematically from the population. Trustworthy conclusions require a sampling method that includes non-clinic-goers, such as random digit dialing or address-based sampling. Here, the conclusion is invalid due to selection bias, teaching that samples from specific venues often fail to generalize unless the venue mirrors the population.
- A school district wants to estimate the proportion of all parents in the district who are satisfied with remote learning options. The district posted a survey link on its website and social media accounts and received 1200 responses; 68% reported being satisfied. The district concluded that "about 68% of all parents in the district are satisfied with remote learning options." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the survey is a voluntary response sample and may overrepresent parents with strong opinions or higher engagement.
Assessing voluntary response sampling and its biases is the key skill in this AP Statistics question, highlighting how data collection methods determine the reliability of conclusions. The district's online survey allows self-selection, likely attracting parents with strong views or higher engagement, overrepresenting satisfied or dissatisfied groups and not reflecting all parents. A distractor such as choice A wrongly prioritizes sample size over method, ignoring that large voluntary samples can still be biased. Trustworthy conclusions demand random sampling to minimize self-selection bias, ensuring every parent has an equal chance to participate. This conclusion is invalid because of the voluntary nature, providing a mini-lesson that engagement-driven responses can skew results, and randomization is crucial for representativeness.
- A state transportation agency investigates the research question: "What proportion of all registered drivers in the state have received a speeding ticket in the past year?" The agency mailed surveys to 2000 randomly selected registered drivers; 620 returned the survey, and 18% of respondents reported a speeding ticket in the past year. The agency concluded that about 18% of all registered drivers received a speeding ticket in the past year. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because drivers who received tickets might be less likely to respond, so nonresponse bias could make 18% an underestimate.
This question demonstrates how nonresponse bias can specifically undermine conclusions when the characteristic being measured might influence response rates. The transportation agency randomly selected drivers, which is appropriate, but only 31% (620/2000) responded to the mailed survey. Critically, drivers who received speeding tickets might be less likely to respond due to embarrassment, legal concerns, or negative associations with government agencies. This differential nonresponse would cause the 18% estimate to underestimate the true proportion of drivers with speeding tickets. The low response rate combined with the sensitive nature of the question makes the conclusion questionable. A more valid approach might use official records rather than self-reported data, or employ methods to increase response rates and assess nonresponse bias.
- A company has 4 departments with different numbers of employees. To estimate the proportion of all employees who prefer working from home at least 3 days per week, an analyst randomly selected 50 employees from each department (200 total) and found that 55% of those sampled preferred working from home at least 3 days per week. The analyst concluded that "about 55% of all employees prefer working from home at least 3 days per week." Which statement explains whether the conclusion is valid?
Answer: The conclusion may not be valid because sampling equal counts from unequal-sized departments overrepresents smaller departments unless results are weighted or a proportional stratified sample is used.
This AP Statistics question focuses on evaluating stratified sampling and the impact of unequal strata sizes on data representativeness, relating to how collection methods influence truthful inferences. The problem arises because the analyst sampled equal numbers from departments of varying sizes, overrepresenting smaller departments and potentially skewing the overall proportion unless weighted adjustments are made. A distractor like choice B misleadingly suggests that equal sampling from strata ensures no bias, but this ignores the need for proportional allocation or weighting in stratified samples. Trustworthy conclusions require that stratified samples reflect the population's composition, either by sampling proportionally or weighting results accordingly to avoid misrepresentation. In this scenario, the conclusion may not be valid without such adjustments, underscoring the mini-lesson that sampling design must align with population structure for accurate generalizations.
- A restaurant chain investigates the research question: "Do customers tip a higher percentage when background music is played than when no music is played?" The population is all dining parties at the chain's locations. For one week, each server chooses whether to play music at their tables; at the end of the week, the mean tip percentage at tables with music is 19.2% and without music is 17.8%. Management concludes that playing music increases tip percentage. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because servers self-selected the condition; confounding (server skill, table type) may explain the difference.
This question highlights confounding in observational studies where subjects self-select their treatment. Servers chose whether to play music at their tables, creating potential confounding variables - perhaps more skilled servers chose to play music, or music was played at certain types of tables. The correct answer B correctly identifies that without random assignment, the observed difference in tips could be due to server characteristics or table selection rather than the music itself. The study design allows servers who believe music helps (or who work better shifts) to systematically choose one condition over another. To establish that music causes higher tips, the restaurant would need to randomly assign tables or time periods to music/no-music conditions, eliminating the possibility that other factors explain the difference.
- A researcher investigates the research question: "Does a new study app improve quiz scores for students in Algebra I?" The population is all Algebra I students at a high school. From all Algebra I classes, the researcher randomly assigns 60 students to use the app for two weeks and 60 students to study as usual; both groups take the same quiz, and the app group has a higher mean score. The researcher concludes that using the app causes higher quiz scores for Algebra I students at the school. Which statement explains whether the conclusion is valid?
Answer: The conclusion is valid because random assignment helps justify a cause-and-effect conclusion for the students in the experiment.
This question demonstrates proper experimental design with random assignment. The researcher randomly assigned students from the population of interest (Algebra I students at the school) to either use the app or study as usual. The correct answer A recognizes that random assignment creates comparable groups, allowing researchers to attribute differences in outcomes to the treatment (app use) rather than confounding variables. This is a well-designed experiment for the specific population studied. However, it's important to note the conclusion is limited to Algebra I students at this particular school - the researcher cannot generalize beyond this population without additional sampling. Random assignment allows causal conclusions for the experimental subjects, making this a trustworthy finding within its scope.
- A school district investigates the research question: "What proportion of all district parents support requiring school uniforms?" The district randomly selected 8 schools from the 32 schools in the district, then surveyed all parents who attended a PTA meeting at each selected school; 64% of those surveyed supported uniforms. The district concluded that about 64% of all district parents support requiring uniforms. Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because surveying only PTA meeting attendees may overrepresent more involved parents, so the sample may not represent all parents in the district.
This question illustrates how cluster sampling can introduce bias when combined with convenience sampling within clusters. While the district appropriately randomly selected 8 schools (clusters) from 32, they then surveyed only parents attending PTA meetings at those schools. PTA meeting attendees likely overrepresent parents who are more involved in school activities, have strong opinions about school policies, and have schedules permitting meeting attendance. These parents may have different views on uniforms than less-involved parents or those unable to attend meetings. The 64% support estimate probably doesn't represent all district parents accurately. For valid conclusions, the district should have randomly sampled parents within each selected school rather than relying on PTA meeting attendance, which creates a biased sub-sample within each cluster.
- A school principal wants to estimate the proportion of students at the school who eat breakfast every school day. She emailed a survey link to all 1800 students and used the first 300 responses received within 2 hours. Of those 300, 62% reported eating breakfast every school day. She concluded that "about 62% of all students at the school eat breakfast every school day." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the first 300 respondents form a voluntary response sample that may differ from students who responded later or not at all.
In AP Statistics, this question assesses the ability to recognize voluntary response bias and nonresponse issues in data collection, emphasizing how the method affects the truthfulness of conclusions. The key issue is that the principal used the first 300 responses from an email survey, creating a voluntary response sample where quicker responders might differ from others, such as being more likely to eat breakfast or have strong opinions. Choice B is a distractor that wrongly claims a sample of 300 is always sufficient, disregarding the bias from self-selection and timing. For trustworthy conclusions, surveys should aim for high response rates and random selection to avoid nonresponse bias, where nonresponders might have different characteristics than responders. Here, the conclusion is invalid due to potential differences between early responders and the rest of the student body, teaching that response mechanisms must be considered for accurate population estimates.
- A county wants to estimate the proportion of households that have access to high-speed internet. The county divided the county into 10 geographic regions and then randomly selected 2 regions to survey. Within each selected region, the county surveyed every household and found that 58% of surveyed households had high-speed internet. The county concluded that "about 58% of all households in the county have access to high-speed internet." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because selecting only 2 regions is cluster sampling, and if the chosen regions differ from others, the result may not represent the entire county.
The skill tested in this AP Statistics question is recognizing limitations in cluster sampling with few clusters, and how it impacts the validity of population inferences. The county selected only 2 out of 10 regions as clusters and surveyed all households within them, but with so few clusters, the sample may not capture county-wide variability if the chosen regions differ from others. Choice C distracts by claiming cluster sampling is always representative for geographic areas, but representativeness depends on random selection and sufficient clusters. Trustworthy conclusions in cluster sampling require enough randomly selected clusters to approximate the population's diversity. This conclusion is invalid due to the small number of clusters, highlighting that inadequate cluster counts can lead to bias similar to non-random sampling.
- A grocery chain wants to estimate the proportion of all its customers who use digital coupons. For one week, the chain recorded whether each customer used a digital coupon for every 20th customer who checked out between 5 p.m. and 8 p.m. at each store. In the resulting sample of 900 customers, 41% used a digital coupon. The chain concluded that "about 41% of all customers use digital coupons." Which statement explains whether the conclusion is valid?
Answer: The conclusion is not valid because the sampling frame includes only customers shopping from 5 p.m. to 8 p.m., which may not represent all customers.
This question in AP Statistics tests understanding of systematic sampling and time-based biases in the sampling frame, relating to data collection's impact on truthful insights. The chain sampled every 20th customer only during evening hours, potentially missing daytime shoppers with different coupon habits, thus not representing all customers. Choice A is a distractor that falsely equates systematic sampling with simple random sampling, but systematic methods can be biased if patterns align with the interval. For trustworthy conclusions, systematic sampling should cover the full population variability, including different times if behaviors vary. The conclusion is invalid due to the limited time frame, emphasizing that sampling must encompass all relevant population segments to avoid bias.
