College Political Science Quiz: Public Opinion Polling
20 questions · exam conditions
0:00
Public Opinion PollingQuestion 1 of 20

A television news channel hosts a nightly segment where viewers are asked to text their vote, 'YES' or 'NO', in response to a question about a current event. After one program, the station announces, 'An overwhelming 82% of our viewers believe the new tax plan is unfair. With over 200,000 responses, this result is a clear indicator of public sentiment.'

Why is it inappropriate for the station to claim this result is a 'clear indicator of public sentiment' and to imply high precision due to the large number of responses?

The margin of error for a sample of 200,000 is still too large to make definitive claims.
The sample is self-selected, making it unrepresentative and rendering margin of error calculations invalid.
A 'YES/NO' format oversimplifies the issue, and a Likert scale would have produced a valid result.
Television viewers as a group are not representative of the entire public, introducing a coverage error.
← Back to quizzes

College Political Science Quiz

College Political Science Quiz: Public Opinion Polling

Practice Public Opinion Polling in College Political Science with focused quiz questions that help you check what you know, review explanations, and build confidence with test-style prompts.

What this quiz covers

This quiz focuses on Public Opinion Polling, giving you a quick way to practice the rules, question types, and explanations that matter most for College Political Science.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

All questions

Question 1

A television news channel hosts a nightly segment where viewers are asked to text their vote, 'YES' or 'NO', in response to a question about a current event. After one program, the station announces, 'An overwhelming 82% of our viewers believe the new tax plan is unfair. With over 200,000 responses, this result is a clear indicator of public sentiment.'

Why is it inappropriate for the station to claim this result is a 'clear indicator of public sentiment' and to imply high precision due to the large number of responses?

  1. The margin of error for a sample of 200,000 is still too large to make definitive claims.
  2. The sample is self-selected, making it unrepresentative and rendering margin of error calculations invalid. (correct answer)
  3. A 'YES/NO' format oversimplifies the issue, and a Likert scale would have produced a valid result.
  4. Television viewers as a group are not representative of the entire public, introducing a coverage error.
Explanation: The correct answer is B. The fundamental requirement for a poll to be generalizable to a larger population is that the sample must be selected randomly, giving every member of the population a known chance of being included. In this case, the sample is self-selected (a call-in or text-in poll), meaning only those who feel strongly and are watching the show will respond. This method is not random and is highly prone to bias. Therefore, measures of sampling error like the margin of error cannot be legitimately calculated or applied, and the results cannot be considered representative of the broader public, regardless of the sample's size. A is incorrect; the theoretical margin of error for a random sample of 200,000 would be extremely small, but this is irrelevant because the sample is not random. C is incorrect because while question format is important, it is secondary to the fatal flaw of the sampling method. D is a valid criticism (coverage error), but the more fundamental issue that invalidates the entire enterprise is the self-selection sampling method.

Question 2

A pollster has a sample of 1,000 likely voters and reports a result with a 95% confidence level. The campaign manager, wanting greater certainty in the results from the same poll data, asks the pollster to re-calculate the findings to a 99% confidence level. What is the necessary consequence of this adjustment?

  1. The margin of error will decrease to reflect the greater certainty.
  2. The margin of error will increase to define a wider range of plausible values. (correct answer)
  3. The margin of error will remain unchanged, but the point estimates will shift.
  4. The pollster must state that a change in confidence level is not possible without resampling.
Explanation: The correct answer is B. There is a trade-off between the confidence level and the margin of error. To be more confident (e.g., 99% vs. 95%) that a confidence interval contains the true population value, the interval must be wider. A wider interval means a larger margin of error. The calculation for the margin of error directly incorporates a value (a z-score) that is larger for higher confidence levels. A is incorrect as it reverses the relationship; greater confidence requires a wider, not narrower, interval. C is incorrect because the point estimates (the poll's headline percentages) are based on the sample data and do not change. The margin of error is what changes. D is incorrect because it is possible to calculate a confidence interval at any level for a given sample; the only thing that changes is the margin of error.

Question 3

In a survey, 56% of male respondents and 48% of female respondents favor a certain policy. The overall poll of 1,000 people has a margin of error of ±3%, and the sample contains roughly equal numbers of men and women. What is the most appropriate step to determine if the 8-point 'gender gap' is statistically significant?

  1. Check if the 8-point gap is larger than the overall margin of error of ±3%.
  2. Check if the 8-point gap is larger than twice the overall margin of error, which is ±6%.
  3. Calculate the larger margin of error for the male and female subgroups and use that to assess the gap. (correct answer)
  4. Conclude the gap is significant, as an 8-point difference is substantively important in politics.
Explanation: The correct answer is C. The 8-point gap is a comparison between two subgroups (men and women). The margin of error for each subgroup is larger than the overall poll's MoE because the sample size for each group (approx. 500) is smaller than the total sample (1,000). The correct procedure is to determine the margin of error for the difference between the two subgroups, which is derived from the individual subgroup margins of error. Simply comparing the gap to the overall MoE is incorrect. A and B are incorrect because they use the overall margin of error, which does not apply to a comparison of subgroups. D is incorrect because it confuses substantive significance (whether an 8-point gap is politically meaningful) with statistical significance (whether the observed gap is unlikely to be due to random sampling error).

Question 4

A national poll of 1,200 likely voters reports that 54% approve of a recent piece of legislation, with a margin of error of ±3%. The same poll finds that among the 350 respondents who identify as independent, approval is at 48%. Which statement correctly describes the margin of error for the independent subgroup?

  1. It is identical to the overall margin of error, which is ±3%.
  2. It is smaller than ±3% because the subgroup is more politically homogeneous.
  3. It is larger than ±3% because the sample size of the subgroup is smaller. (correct answer)
  4. It cannot be determined, as margin of error only applies to the entire sample.
Explanation: The correct answer is C. The margin of error is inversely related to the square root of the sample size. Since the subgroup of independents (n=350) is significantly smaller than the total sample (n=1200), its margin of error will be larger than that of the total sample. A larger margin of error reflects greater uncertainty due to the smaller number of respondents in that specific group. A is incorrect because the margin of error is dependent on sample size, and the subgroup's size is different from the total. B is incorrect because it reverses the relationship; a smaller sample size leads to a larger, not smaller, margin of error. Political homogeneity is not the direct statistical driver of the margin of sampling error. D is incorrect because margins of error can and are frequently calculated and reported for key subgroups within a poll.

Question 5

A political campaign commissions a poll with a random sample of 1,600 adults, yielding a margin of error of ±2.5%. The poll asks, 'Given the clear evidence of corruption, do you support the ongoing investigation into the opposition party's leader?' The results show 75% support the investigation. Why should the campaign be cautious in concluding that three-quarters of the public supports the investigation?

  1. The sample size of 1,600 is too small to accurately represent the national population.
  2. The ±2.5% margin of error is too large to draw any meaningful conclusions from a 75% result.
  3. The question wording is emotionally charged and likely biased the responses toward agreement. (correct answer)
  4. The poll should have used a stratified sample instead of a random sample to ensure accuracy.
Explanation: The correct answer is C. The margin of error only accounts for statistical variability from random sampling (sampling error). It does not account for non-sampling errors, such as biased question wording. The phrase 'clear evidence of corruption' presupposes guilt and pressures respondents to agree with the premise, likely inflating the stated level of support. This is a far more significant problem than the sampling error. A is incorrect; a sample size of 1,600 is considered large and is sufficient for a national poll. B is incorrect; a margin of error of ±2.5% is quite small (precise), and even with this MoE, support is overwhelmingly high. The issue is the validity of the measure, not its precision. D is incorrect because while stratified sampling can improve efficiency, a well-conducted simple random sample is a valid scientific method. The primary flaw here is non-sampling error.

Question 6

A poll conducted in a diverse city finds strong support for a new park. The pollsters used random-digit dialing of landlines, resulting in an under-representation of younger and lower-income residents who are more likely to be cell-phone-only. The poll reports a margin of error of ±4%. What is the relationship between this sampling frame issue and the reported margin of error?

  1. The ±4% margin of error fully accounts for the under-representation of certain demographic groups.
  2. The random-digit dialing method ensures the sample is unbiased, so the margin of error is the only source of inaccuracy.
  3. The true margin of error is smaller than ±4% because cell-phone-only users tend to have more uniform opinions.
  4. The sampling frame issue introduces a coverage error, a type of non-sampling error not captured by the margin of error. (correct answer)
Explanation: When analyzing polling accuracy, you need to distinguish between two fundamental types of error: sampling error (what margin of error measures) and non-sampling error (systematic biases in data collection). The reported ±4% margin of error only reflects sampling error - the natural variation that occurs because you're surveying a sample rather than the entire population. This assumes your sample is representative of your target population. However, the landline-only approach creates a coverage error, where certain groups (younger, lower-income residents) are systematically excluded from even having a chance to be selected. Coverage error is a type of non-sampling error that introduces systematic bias into results. Since cell-phone-only users may have different opinions about the park than landline users, the poll's results could be skewed regardless of sample size. Looking at the wrong answers: (A) incorrectly assumes margin of error accounts for demographic under-representation - it doesn't. (B) wrongly claims random-digit dialing ensures an unbiased sample, but you can randomly sample from a biased sampling frame. (C) makes an unsupported assumption that cell-phone users have more uniform opinions, and even if true, this wouldn't reduce the margin of error. The correct answer is (D) because the sampling frame problem creates coverage error that exists completely separate from and in addition to the reported margin of error. Study tip: Remember that margin of error only measures sampling error from random variation. Any systematic bias in who can be reached or who responds creates additional error not captured in that ±% figure.

Question 7

A polling organization conducts a random-digit-dial survey and finds that its sample of respondents contains a higher percentage of college graduates than the national population. To correct this, analysts apply a weight to the responses, giving more influence to respondents without a college degree. How does this weighting process typically affect the poll's margin of error?

  1. It decreases the margin of error because the sample is now more representative.
  2. It has no effect on the margin of error, which is based only on the unweighted sample size.
  3. It increases the margin of error because it effectively reduces the diversity of the sample information. (correct answer)
  4. It eliminates the margin of error by creating a perfectly representative demographic profile.
Explanation: The correct answer is C. While weighting corrects for known demographic imbalances and reduces bias, it usually comes at the cost of statistical precision. When some respondents' answers are given more weight than others, it increases the variance of the estimate, which in turn widens the confidence interval and increases the margin of error. This is often referred to as the 'design effect' of weighting. The poll becomes less biased but more uncertain. A is a very plausible but incorrect distractor; students often conflate representativeness with precision. Weighting improves the former at the expense of the latter. B is incorrect because the calculation for the margin of error on weighted data is different and almost always results in a larger MoE. D is incorrect; weighting can never eliminate sampling error.

Question 8

A national poll of 1,200 likely voters reports that 54% approve of a recent piece of legislation, with a margin of error of ±3%. The same poll finds that among the 350 respondents who identify as independent, approval is at 48%. Which statement correctly describes the margin of error for the independent subgroup?

  1. It is identical to the overall margin of error, which is ±3%.
  2. It is smaller than ±3% because the subgroup is more politically homogeneous.
  3. It is larger than ±3% because the sample size of the subgroup is smaller. (correct answer)
  4. It cannot be determined, as margin of error only applies to the entire sample.
Explanation: The correct answer is C. The margin of error is inversely related to the square root of the sample size. Since the subgroup of independents (n=350) is significantly smaller than the total sample (n=1200), its margin of error will be larger than that of the total sample. A larger margin of error reflects greater uncertainty due to the smaller number of respondents in that specific group. A is incorrect because the margin of error is dependent on sample size, and the subgroup's size is different from the total. B is incorrect because it reverses the relationship; a smaller sample size leads to a larger, not smaller, margin of error. Political homogeneity is not the direct statistical driver of the margin of sampling error. D is incorrect because margins of error can and are frequently calculated and reported for key subgroups within a poll.

Question 9

A polling firm conducts a survey of 400 people, which yields a margin of error of approximately ±5%. The firm's client desires a higher level of precision and requests that the poll be redone to achieve a margin of error of approximately ±2.5%. To accomplish this, the polling firm must adjust its sample size by what factor?

  1. The sample size must be decreased by half.
  2. The sample size must be doubled.
  3. The sample size must be quadrupled. (correct answer)
  4. The sample size must be increased by 2.5%.
Explanation: The correct answer is C. The margin of error is inversely proportional to the square root of the sample size (n). To cut the margin of error in half (from 5% to 2.5%), one must increase the sample size by a factor of four. Mathematically, if MoE is proportional to 1/n1/\sqrt{n}, then to get 1/21/2 of the MoE, we need 1/4n1/\sqrt{4n}, which simplifies to 1/(2n)1/(2\sqrt{n}). Thus, the sample size nn must be quadrupled. A is incorrect because decreasing the sample size would increase the margin of error. B is incorrect because doubling the sample size would only decrease the margin of error by a factor of 2\sqrt{2}, not by a factor of 2. D is incorrect because it confuses the percentage point change in the margin of error with the necessary change in sample size.

Question 10

In a gubernatorial race, a poll shows Candidate A with 49% support and Candidate B with 45% support. The poll has a margin of error of ±3%. A news report accurately headlines the race as a 'statistical tie.' What is the primary reason for this characterization?

  1. The 4% gap between the candidates is less than twice the margin of error, suggesting the lead is not statistically significant. (correct answer)
  2. Neither candidate has reached the 50% threshold required to win the election outright.
  3. The presence of undecided voters, not accounted for in the percentages, could alter the outcome.
  4. Any lead that is smaller than the margin of error is, by definition, statistically insignificant.
Explanation: The correct answer is A. To determine if a lead is statistically significant, one must consider the margin of error for the difference between the two candidates, which is approximately double the margin of error for an individual candidate's support. In this case, the margin of error for the 4% gap is roughly ±6%. Since the observed gap of 4% is smaller than this margin of error, we cannot be confident that Candidate A is truly in the lead. Another way to see this is that Candidate A's support interval is [46%, 52%] and Candidate B's is [42%, 48%]. Because these intervals overlap, the race is a statistical tie. B is incorrect because a race can have a clear leader even if no one is above 50%. C is incorrect because while undecided voters add uncertainty, the term 'statistical tie' specifically refers to the relationship between the candidates' numbers and the sampling error. D is a common oversimplification; the more accurate rule of thumb involves comparing the gap to twice the margin of error.

Question 11

A final pre-election poll shows the incumbent at 52% and the challenger at 48%, with a margin of error of ±3.5%. The actual election result is 50.5% for the incumbent and 49.5% for the challenger. Based on a statistical interpretation, how should the poll's performance be evaluated?

  1. The poll was inaccurate because it failed to predict the winner would have a margin of only 1%.
  2. The poll was accurate because the election results for both candidates fell within the poll's confidence intervals. (correct answer)
  3. The poll was biased against the challenger, as indicated by the underestimation of their support.
  4. The poll's accuracy cannot be judged, as late-deciding voters are not covered by the margin of error.
Explanation: The correct answer is B. A poll is considered accurate if the true value (the election result) falls within its calculated confidence interval. The interval for the incumbent was 52% ± 3.5%, which is [48.5%, 55.5%]. The actual result of 50.5% is within this interval. The interval for the challenger was 48% ± 3.5%, which is [44.5%, 51.5%]. The actual result of 49.5% is also within this interval. Therefore, the poll performed as expected within its stated margin of error. A is incorrect because a poll is not expected to predict the exact outcome, but rather to provide a probable range. The gap of 4% in the poll was statistically indistinguishable from the 1% gap in the election. C is incorrect because a single poll's deviation from the final result, when within the margin of error, is more likely statistical noise than evidence of systematic bias. D is incorrect because while late-deciders are a challenge for prediction, the poll's statistical accuracy is still evaluated by comparing the final numbers to its confidence interval.

Question 12

A television news channel hosts a nightly segment where viewers are asked to text their vote, 'YES' or 'NO', in response to a question about a current event. After one program, the station announces, 'An overwhelming 82% of our viewers believe the new tax plan is unfair. With over 200,000 responses, this result is a clear indicator of public sentiment.'

Why is it inappropriate for the station to claim this result is a 'clear indicator of public sentiment' and to imply high precision due to the large number of responses?

  1. The margin of error for a sample of 200,000 is still too large to make definitive claims.
  2. The sample is self-selected, making it unrepresentative and rendering margin of error calculations invalid. (correct answer)
  3. A 'YES/NO' format oversimplifies the issue, and a Likert scale would have produced a valid result.
  4. Television viewers as a group are not representative of the entire public, introducing a coverage error.
Explanation: The correct answer is B. The fundamental requirement for a poll to be generalizable to a larger population is that the sample must be selected randomly, giving every member of the population a known chance of being included. In this case, the sample is self-selected (a call-in or text-in poll), meaning only those who feel strongly and are watching the show will respond. This method is not random and is highly prone to bias. Therefore, measures of sampling error like the margin of error cannot be legitimately calculated or applied, and the results cannot be considered representative of the broader public, regardless of the sample's size. A is incorrect; the theoretical margin of error for a random sample of 200,000 would be extremely small, but this is irrelevant because the sample is not random. C is incorrect because while question format is important, it is secondary to the fatal flaw of the sampling method. D is a valid criticism (coverage error), but the more fundamental issue that invalidates the entire enterprise is the self-selection sampling method.

Question 13

A poll reports that a ballot initiative is supported by 53% of voters, with a margin of error of ±4% at a 95% confidence level. Which of the following statements represents the most accurate interpretation of this result?

  1. There is a 95% chance that between 49% and 57% of the electorate supports the initiative.
  2. We can be 95% confident that the election outcome will fall somewhere between 49% and 57%.
  3. The initiative is statistically guaranteed to pass, as the point estimate of 53% is above the 50% threshold.
  4. If the poll were conducted 100 times, 95 of the resulting confidence intervals would contain the true level of support. (correct answer)
Explanation: When you encounter polling data with confidence intervals, you're dealing with statistical inference—the process of making conclusions about a population based on a sample. The key is understanding what a confidence interval actually tells us about the reliability of our sampling method, not about any single poll result. The correct interpretation is found in answer choice D. A 95% confidence interval means that if you repeated the same polling methodology 100 times with different random samples, approximately 95 of those intervals would contain the true population parameter (the actual level of support among all voters). This describes the long-run performance of the sampling method itself. Answer A incorrectly suggests there's a 95% probability that the true support falls within this specific interval. This commits the common error of treating the population parameter as random when it's actually fixed—we just don't know its value. Answer B makes a similar mistake by suggesting we can predict election outcomes with 95% confidence. Polls measure current opinion, but elections involve turnout, campaign effects, and other variables that polling can't capture. Answer C ignores the uncertainty entirely. Even though 53% exceeds 50%, the margin of error means the true support could be as low as 49%, making the outcome uncertain. Remember this distinction: confidence intervals describe the reliability of your method across many samples, not the probability that any single interval contains the true value. This concept appears frequently in political science research methodology questions.

Question 14

A political analyst notes that a candidate's polling numbers have shifted from 45% to 48% over one month. Both polls used the same methodology and had a margin of error of ±3%. The analyst dismisses the change as 'statistical noise.' This conclusion is based on the principle that:

  1. the confidence intervals of the two polls likely overlap, meaning the change is not statistically significant. (correct answer)
  2. the candidate is still polling below the 50% majority threshold.
  3. any change smaller than 5% should be considered politically insignificant.
  4. public opinion on a candidate rarely changes in such a short period of time.
Explanation: When you encounter questions about polling data and statistical significance, focus on understanding margin of error and confidence intervals. These concepts are fundamental to interpreting whether observed changes in polls represent real shifts in public opinion or just random variation. The analyst correctly identifies this as "statistical noise" because the confidence intervals overlap. With a ±3% margin of error, the first poll suggests the true support could range from 42% to 48%, while the second poll indicates a range of 45% to 51%. Since these ranges overlap substantially (45%-48%), the apparent 3-point increase could easily be explained by sampling variation rather than actual change in voter preferences. This is why option A is correct. Option B misses the point entirely—whether the candidate is above or below 50% doesn't determine if a change is statistically significant. The 50% threshold is politically important but irrelevant to statistical analysis. Option C creates an arbitrary 5% rule that has no basis in statistical theory; significance depends on margin of error, not a fixed percentage threshold. Option D makes an empirical claim about how quickly public opinion changes, but this varies greatly depending on events and circumstances, and regardless, it doesn't address the statistical question at hand. Remember this key principle: when margins of error cause confidence intervals to overlap, you cannot conclude that an observed difference represents a real change. Always check whether the difference between polls exceeds the combined margins of error before declaring a trend statistically meaningful.

Question 15

A polling firm is designing a survey and can choose to sample 400 people, which gives a margin of error of ±5%, or sample 1,600 people, which gives a margin of error of ±2.5%. Which of the following is the most accurate statement regarding this trade-off?

  1. A fourfold increase in sample size is required to cut the margin of error in half, demonstrating diminishing returns. (correct answer)
  2. The smaller sample is more cost-effective and provides a result that is only slightly less precise.
  3. The larger sample should always be chosen as it eliminates the possibility of sampling error.
  4. The precision of the poll increases linearly with the sample size, so a sample of 800 would yield a MoE of ±3.75%.
Explanation: When you encounter questions about polling and margin of error, focus on the mathematical relationship between sample size and statistical precision. This relationship follows a square root rule that creates diminishing returns. The margin of error decreases proportionally to the square root of the sample size increase. Here, the sample size quadruples from 400 to 1,600 people (a 4x increase), and the margin of error drops from ±5% to ±2.5% (cut in half). This demonstrates the square root relationship: 4=2\sqrt{4} = 2, so a fourfold increase in sample size yields a twofold decrease in margin of error. This perfectly illustrates diminishing returns—you need exponentially more respondents to achieve linear improvements in precision. Looking at the wrong answers: B) incorrectly suggests the precision difference is slight, when halving the margin of error represents a substantial improvement in statistical reliability. C) makes the impossible claim that larger samples eliminate sampling error entirely—no sample can completely eliminate this inherent uncertainty unless you survey the entire population. D) demonstrates a fundamental misunderstanding by claiming precision increases linearly with sample size. If this were true, 800 people would yield ±3.75% margin of error, but the actual relationship means it would be closer to ±3.5%. Remember this square root rule for any polling question: doubling precision requires quadrupling the sample. This mathematical reality explains why political polls rarely exceed 1,000-2,000 respondents—the cost of additional precision quickly becomes prohibitive.

Question 16

A poll reports that a ballot initiative is supported by 53% of voters, with a margin of error of ±4% at a 95% confidence level. Which of the following statements represents the most accurate interpretation of this result?

  1. There is a 95% chance that between 49% and 57% of the electorate supports the initiative.
  2. We can be 95% confident that the election outcome will fall somewhere between 49% and 57%.
  3. The initiative is statistically guaranteed to pass, as the point estimate of 53% is above the 50% threshold.
  4. If the poll were conducted 100 times, 95 of the resulting confidence intervals would contain the true level of support. (correct answer)
Explanation: When you encounter polling data with confidence intervals, you're dealing with statistical inference—the process of making conclusions about a population based on a sample. The key is understanding what a confidence interval actually tells us about the reliability of our sampling method, not about any single poll result. The correct interpretation is found in answer choice D. A 95% confidence interval means that if you repeated the same polling methodology 100 times with different random samples, approximately 95 of those intervals would contain the true population parameter (the actual level of support among all voters). This describes the long-run performance of the sampling method itself. Answer A incorrectly suggests there's a 95% probability that the true support falls within this specific interval. This commits the common error of treating the population parameter as random when it's actually fixed—we just don't know its value. Answer B makes a similar mistake by suggesting we can predict election outcomes with 95% confidence. Polls measure current opinion, but elections involve turnout, campaign effects, and other variables that polling can't capture. Answer C ignores the uncertainty entirely. Even though 53% exceeds 50%, the margin of error means the true support could be as low as 49%, making the outcome uncertain. Remember this distinction: confidence intervals describe the reliability of your method across many samples, not the probability that any single interval contains the true value. This concept appears frequently in political science research methodology questions.

Question 17

A political analyst notes that a candidate's polling numbers have shifted from 45% to 48% over one month. Both polls used the same methodology and had a margin of error of ±3%. The analyst dismisses the change as 'statistical noise.' This conclusion is based on the principle that:

  1. the confidence intervals of the two polls likely overlap, meaning the change is not statistically significant. (correct answer)
  2. the candidate is still polling below the 50% majority threshold.
  3. any change smaller than 5% should be considered politically insignificant.
  4. public opinion on a candidate rarely changes in such a short period of time.
Explanation: When you encounter questions about polling data and statistical significance, focus on understanding margin of error and confidence intervals. These concepts are fundamental to interpreting whether observed changes in polls represent real shifts in public opinion or just random variation. The analyst correctly identifies this as "statistical noise" because the confidence intervals overlap. With a ±3% margin of error, the first poll suggests the true support could range from 42% to 48%, while the second poll indicates a range of 45% to 51%. Since these ranges overlap substantially (45%-48%), the apparent 3-point increase could easily be explained by sampling variation rather than actual change in voter preferences. This is why option A is correct. Option B misses the point entirely—whether the candidate is above or below 50% doesn't determine if a change is statistically significant. The 50% threshold is politically important but irrelevant to statistical analysis. Option C creates an arbitrary 5% rule that has no basis in statistical theory; significance depends on margin of error, not a fixed percentage threshold. Option D makes an empirical claim about how quickly public opinion changes, but this varies greatly depending on events and circumstances, and regardless, it doesn't address the statistical question at hand. Remember this key principle: when margins of error cause confidence intervals to overlap, you cannot conclude that an observed difference represents a real change. Always check whether the difference between polls exceeds the combined margins of error before declaring a trend statistically meaningful.

Question 18

A poll reports that 60% of Americans support a policy, with a margin of error of ±3 percentage points at a 95% confidence level. A student interprets this to mean 'there is a 95% probability that the true level of support is between 57% and 63%.' Why is this common interpretation technically incorrect from a frequentist statistical perspective?

  1. The calculation of the interval is wrong; it should be 60% ± 6 percentage points.
  2. The confidence level refers to the long-run success rate of the polling method, not the probability associated with a single, specific result. (correct answer)
  3. The interpretation is only correct if the poll used a sample size of exactly 1,000 people.
  4. The margin of error must first be converted into a standard deviation to make a probability statement.
Explanation: The correct answer is B. This is a subtle but crucial point in statistics. In the frequentist view, the 'true' population parameter is a fixed, unknown constant. It does not vary. The confidence interval, however, is calculated from a random sample and is therefore a random quantity. The 95% confidence level means that if this polling procedure were repeated infinitely, 95% of the confidence intervals produced would contain the true parameter. For any one specific interval like [57%, 63%], the true value is either in it or it is not; we do not assign a probability to it. The student's statement is an example of the 'fallacy of the transposed conditional.' A, C, and D are incorrect as they introduce irrelevant or incorrect statistical details. The core issue is the conceptual interpretation of the confidence level itself.

Question 19

A polling firm conducts a survey of 400 people, which yields a margin of error of approximately ±5%. The firm's client desires a higher level of precision and requests that the poll be redone to achieve a margin of error of approximately ±2.5%. To accomplish this, the polling firm must adjust its sample size by what factor?

  1. The sample size must be decreased by half.
  2. The sample size must be doubled.
  3. The sample size must be quadrupled. (correct answer)
  4. The sample size must be increased by 2.5%.
Explanation: The correct answer is C. The margin of error is inversely proportional to the square root of the sample size (n). To cut the margin of error in half (from 5% to 2.5%), one must increase the sample size by a factor of four. Mathematically, if MoE is proportional to 1/n1/\sqrt{n}, then to get 1/21/2 of the MoE, we need 1/4n1/\sqrt{4n}, which simplifies to 1/(2n)1/(2\sqrt{n}). Thus, the sample size nn must be quadrupled. A is incorrect because decreasing the sample size would increase the margin of error. B is incorrect because doubling the sample size would only decrease the margin of error by a factor of 2\sqrt{2}, not by a factor of 2. D is incorrect because it confuses the percentage point change in the margin of error with the necessary change in sample size.

Question 20

A final pre-election poll shows the incumbent at 52% and the challenger at 48%, with a margin of error of ±3.5%. The actual election result is 50.5% for the incumbent and 49.5% for the challenger. Based on a statistical interpretation, how should the poll's performance be evaluated?

  1. The poll was inaccurate because it failed to predict the winner would have a margin of only 1%.
  2. The poll was accurate because the election results for both candidates fell within the poll's confidence intervals. (correct answer)
  3. The poll was biased against the challenger, as indicated by the underestimation of their support.
  4. The poll's accuracy cannot be judged, as late-deciding voters are not covered by the margin of error.
Explanation: The correct answer is B. A poll is considered accurate if the true value (the election result) falls within its calculated confidence interval. The interval for the incumbent was 52% ± 3.5%, which is [48.5%, 55.5%]. The actual result of 50.5% is within this interval. The interval for the challenger was 48% ± 3.5%, which is [44.5%, 51.5%]. The actual result of 49.5% is also within this interval. Therefore, the poll performed as expected within its stated margin of error. A is incorrect because a poll is not expected to predict the exact outcome, but rather to provide a probable range. The gap of 4% in the poll was statistically indistinguishable from the 1% gap in the election. C is incorrect because a single poll's deviation from the final result, when within the margin of error, is more likely statistical noise than evidence of systematic bias. D is incorrect because while late-deciders are a challenge for prediction, the poll's statistical accuracy is still evaluated by comparing the final numbers to its confidence interval.