IB Mathematics: Applications and Interpretation Quiz: Cis And Hypothesis Testing
20 questions · exam conditions
0:00
Cis And Hypothesis TestingQuestion 1 of 20

A study is conducted to compare the performance of two types of running shoes, A and B. Ten runners are selected, and each runner completes a 5 km run with shoe A and, on a different day, a 5 km run with shoe B. The times are recorded. A paired t-test is performed to see if there is a significant difference in running times. The resulting p-value is 0.027. Using a 5% significance level, what is the most appropriate conclusion?

At the 5% significance level, there is not enough evidence to conclude a difference in mean running times between the two shoe types.
The p-value of 0.027 means there is a 2.7% chance that the null hypothesis of no difference is true.
At the 5% significance level, there is sufficient evidence to suggest a significant difference in mean running times between the two shoe types.
An unpaired t-test should have been used because there are two different types of shoes, so the conclusion is invalid.
← Back to quizzes

IB Mathematics: Applications and Interpretation Quiz

IB Mathematics: Applications and Interpretation Quiz: Cis And Hypothesis Testing

Practice Cis And Hypothesis Testing in IB Mathematics: Applications and Interpretation with focused quiz questions that help you check what you know, review explanations, and build confidence with test-style prompts.

What this quiz covers

This quiz focuses on Cis And Hypothesis Testing, giving you a quick way to practice the rules, question types, and explanations that matter most for IB Mathematics: Applications and Interpretation.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

All questions

Question 1

A study is conducted to compare the performance of two types of running shoes, A and B. Ten runners are selected, and each runner completes a 5 km run with shoe A and, on a different day, a 5 km run with shoe B. The times are recorded. A paired t-test is performed to see if there is a significant difference in running times. The resulting p-value is 0.027. Using a 5% significance level, what is the most appropriate conclusion?

  1. At the 5% significance level, there is not enough evidence to conclude a difference in mean running times between the two shoe types.
  2. The p-value of 0.027 means there is a 2.7% chance that the null hypothesis of no difference is true.
  3. At the 5% significance level, there is sufficient evidence to suggest a significant difference in mean running times between the two shoe types. (correct answer)
  4. An unpaired t-test should have been used because there are two different types of shoes, so the conclusion is invalid.
Explanation: The significance level is α=0.05\alpha = 0.05. The p-value is 0.027. Since the p-value (0.027) is less than the significance level (0.05), we reject the null hypothesis. Rejecting the null hypothesis means we have found statistically significant evidence of a difference. Therefore, there is sufficient evidence to suggest a difference in mean running times.\nA is incorrect because p < α\alpha.\nB is a common misinterpretation of the p-value. The p-value is the probability of observing the data (or more extreme data) if the null hypothesis were true, not the probability that the null hypothesis is true.\nD is incorrect because the study design, where each runner tests both shoes, is a classic example of a paired design. A paired t-test is the appropriate choice.

Question 2

A manufacturer claims that its chocolate bars weigh an average of 50.0 g. A quality control inspector takes a random sample of 25 bars and finds the sample mean weight is 49.6 g with a sample standard deviation of 1.2 g. A t-test is conducted to test if the true mean weight is different from 50.0 g. The resulting p-value is 0.108. Using a significance level of α=0.05\alpha = 0.05, what is the correct conclusion?

  1. Reject H0H_0. There is strong evidence that the mean weight is not 50.0 g.
  2. Fail to reject H0H_0. There is insufficient evidence to conclude that the mean weight is different from 50.0 g. (correct answer)
  3. Reject H0H_0. The evidence proves that the mean weight is less than 50.0 g.
  4. Fail to reject H0H_0. This proves that the mean weight is exactly 50.0 g.
Explanation: The decision rule in hypothesis testing is to compare the p-value to the significance level (α\alpha). If p-value α\leq \alpha, we reject the null hypothesis (H0H_0). If p-value >α> \alpha, we fail to reject H0H_0. In this case, the p-value is 0.108, and α\alpha is 0.05. Since 0.108 > 0.05, we fail to reject H0H_0. This means we do not have enough statistical evidence to say the mean weight is different from 50.0 g.\nA is incorrect because p > α\alpha.\nC is incorrect for the same reason, and it also uses overly strong language ('proves').\nD is incorrect because failing to reject H0H_0 does not prove that H0H_0 is true. It only means we lack sufficient evidence to say it's false.

Question 3

An economist wants to compare the mean starting salaries for graduates in two different fields: Engineering and Business. A random sample of 30 recent Engineering graduates has a mean salary of $68,000 with a standard deviation of $5,000. A random sample of 35 recent Business graduates has a mean salary of $64,000 with a standard deviation of $4,500. What is the 99% confidence interval for the difference between the mean salaries (μEngμBus\mu_{Eng} - \mu_{Bus})?

  1. [$817, $7183] (correct answer)
  2. [$886, $7114]
  3. [$1634, $6366]
  4. [$3089, $4911]
Explanation: This requires a two-sample t-interval for the difference between two means. Using a graphing calculator, enter the statistics for the two samples:\nGroup 1 (Eng): xˉ1=68000,s1=5000,n1=30\bar{x}_1 = 68000, s_1 = 5000, n_1 = 30\nGroup 2 (Bus): xˉ2=64000,s2=4500,n2=35\bar{x}_2 = 64000, s_2 = 4500, n_2 = 35\nSet the confidence level to 0.99 and select the 'unpooled' option (as we don't assume equal variances). The calculator will compute the interval for μ1μ2\mu_1 - \mu_2. The resulting 99% confidence interval is approximately [$817, $7183].\nC is the 95% confidence interval, a common error if the wrong confidence level is used.\nB is the interval that would be calculated if the 'pooled' option were incorrectly selected, which assumes the population variances are equal.\nD is an incorrect calculation.

Question 4

An environmental scientist calculates a 95% confidence interval for the mean concentration of a pollutant in a lake based on a sample of nn measurements. Which of the following changes would most likely result in a narrower confidence interval?

  1. Decreasing the sample size to n/2n/2.
  2. Increasing the confidence level to 99%.
  3. Decreasing the sample mean by 10%.
  4. Increasing the sample size to 2n2n. (correct answer)
Explanation: The width of a confidence interval is determined by the margin of error, which is calculated as tcrit×snt_{crit} \times \frac{s}{\sqrt{n}}. To make the interval narrower, we need to decrease the margin of error. Increasing the sample size nn to 2n2n increases the denominator, which decreases the margin of error and thus narrows the interval.\nA is incorrect because decreasing the sample size would increase the margin of error, making the interval wider.\nB is incorrect because increasing the confidence level increases the critical value (tcritt_{crit}), which makes the interval wider.\nC is incorrect because changing the sample mean shifts the center of the interval but does not affect its width.

Question 5

An e-commerce company runs an experiment on its website with 500,000 users to test a new 'buy' button color. The null hypothesis is that the new color has no effect on the click-through rate. The test yields a p-value of 0.0001, and the 95% confidence interval for the increase in click-through rate is [0.01%, 0.03%]. Which is the best interpretation of these results?

  1. The p-value is very small, so the new color is highly effective and should be implemented immediately.
  2. The confidence interval contains only positive values, which contradicts the small p-value, so the results are likely invalid.
  3. The result is statistically significant, but the magnitude of the effect is very small, so the business impact may not be meaningful. (correct answer)
  4. The sample size was too large, which artificially lowered the p-value; the study should be repeated with a smaller sample.
Explanation: This question tests the difference between statistical significance and practical significance. The very small p-value (<0.05) indicates a statistically significant result; we have strong evidence that the new button color has an effect. However, the confidence interval [0.01%, 0.03%] shows that the size of this effect is very small. An increase of just 0.01% might not be enough to justify the cost of making the change. Therefore, the result is statistically significant but may not be practically important.\nA ignores the small effect size shown by the confidence interval.\nB is incorrect; a CI for the difference that does not contain zero is consistent with a small p-value.\nD is incorrect. A large sample size gives more power to detect even small effects; it does not make the result 'artificial'.

Question 6

A company manufactures bolts and uses a hypothesis test to check if the mean diameter meets the specification of 8.00 mm. The null hypothesis is H0:μ=8.00H_0: \mu = 8.00. They set the significance level α\alpha to 0.01. What is the meaning of this significance level?

  1. It is the probability that any given bolt has a diameter of exactly 8.00 mm.
  2. It is the probability of concluding the mean diameter is not 8.00 mm when it actually is 8.00 mm. (correct answer)
  3. It is the probability of failing to detect that the mean diameter is actually not 8.00 mm.
  4. It means that 99% of the manufactured bolts will meet the specification.
Explanation: The significance level, α\alpha, is the probability of making a Type I error. A Type I error is the rejection of a true null hypothesis. In this context, the null hypothesis is that the mean diameter is 8.00 mm. Rejecting this hypothesis means concluding the mean diameter is not 8.00 mm. Therefore, α=0.01\alpha = 0.01 is the probability of concluding the mean is not 8.00 mm when, in fact, it is.\nA is an incorrect interpretation of probability in this context.\nC describes the probability of a Type II error (β\beta).\nD confuses the significance level of a hypothesis test with a statement about the proportion of individual items meeting a specification.

Question 7

An educational researcher conducts a study to determine if a new teaching method improves student test scores. The null hypothesis is that the new method has no effect on scores. After the study, the researcher rejects the null hypothesis at a 5% significance level. What would a Type I error represent in this context?

  1. Concluding that the new method improves scores when, in reality, it does not. (correct answer)
  2. Concluding that the new method does not improve scores when, in reality, it does.
  3. Correctly concluding that the new method improves scores.
  4. Failing to collect a large enough sample to detect a true improvement in scores.
Explanation: A Type I error occurs when we reject a true null hypothesis (H0H_0). In this context, H0H_0 is 'the new method has no effect'. Rejecting H0H_0 means concluding the method does have an effect (it improves scores). Therefore, a Type I error is concluding the method improves scores when it actually does not.\nB describes a Type II error (failing to reject a false H0H_0).\nC describes a correct decision.\nD relates to the concept of statistical power, which is linked to Type II errors, not Type I.

Question 8

An environmental scientist calculates a 95% confidence interval for the mean concentration of a pollutant in a lake based on a sample of nn measurements. Which of the following changes would most likely result in a narrower confidence interval?

  1. Decreasing the sample size to n/2n/2.
  2. Increasing the confidence level to 99%.
  3. Decreasing the sample mean by 10%.
  4. Increasing the sample size to 2n2n. (correct answer)
Explanation: The width of a confidence interval is determined by the margin of error, which is calculated as tcrit×snt_{crit} \times \frac{s}{\sqrt{n}}. To make the interval narrower, we need to decrease the margin of error. Increasing the sample size nn to 2n2n increases the denominator, which decreases the margin of error and thus narrows the interval.\nA is incorrect because decreasing the sample size would increase the margin of error, making the interval wider.\nB is incorrect because increasing the confidence level increases the critical value (tcritt_{crit}), which makes the interval wider.\nC is incorrect because changing the sample mean shifts the center of the interval but does not affect its width.

Question 9

A pharmaceutical company has developed a new drug to reduce blood pressure. The current standard drug reduces systolic blood pressure by an average of 15 mmHg. The company wants to test if the new drug is more effective than the standard drug. Let μ\mu be the true mean reduction in systolic blood pressure for the new drug. How should the null and alternative hypotheses be formulated?

  1. H0:μ=15H_0: \mu = 15, H1:μ15H_1: \mu \neq 15
  2. H0:μ=15H_0: \mu = 15, H1:μ>15H_1: \mu > 15 (correct answer)
  3. H0:μ>15H_0: \mu > 15, H1:μ15H_1: \mu \leq 15
  4. H0:μ15H_0: \mu \leq 15, H1:μ>15H_1: \mu > 15
Explanation: The null hypothesis (H0H_0) is a statement of no effect or no difference, and it always contains the equality. In this case, it's that the new drug has the same effectiveness as the old one, so H0:μ=15H_0: \mu = 15. The alternative hypothesis (H1H_1) is what the researchers want to find evidence for, which is that the new drug is more effective. A greater reduction in blood pressure means a value larger than 15. Therefore, the alternative hypothesis is H1:μ>15H_1: \mu > 15. This is a one-tailed (right-tailed) test.\nA describes a two-tailed test, which would check if the drug is simply different (more or less effective).\nC and D incorrectly place the inequality in the null hypothesis.

Question 10

An automotive company claims that its new hybrid car model has a mean fuel efficiency of at least 50 miles per gallon (mpg). A consumer agency tests a sample of 40 cars and finds a sample mean of 48.9 mpg. The agency wants to test the company's claim. They perform a hypothesis test and find that if they had incorrectly performed a two-tailed test (H1:μ50H_1: \mu \neq 50), the p-value would be 0.024. What is the correct p-value for the appropriate one-tailed test (H1:μ<50H_1: \mu < 50)?

  1. 0.012 (correct answer)
  2. 0.024
  3. 0.048
  4. 0.988
Explanation: The company's claim is μ50\mu \geq 50. The agency wants to find evidence against this, so the alternative hypothesis is H1:μ<50H_1: \mu < 50. This is a one-tailed (left-tailed) test. The sample mean (48.9) is in the direction of the alternative hypothesis. For a symmetric distribution like the t-distribution, the p-value for a one-tailed test is half the p-value for a two-tailed test, provided the sample result is in the direction specified by H1H_1. Therefore, the correct p-value is 0.024/2=0.0120.024 / 2 = 0.012.\nB is the p-value for the incorrect two-tailed test.\nC would be double the two-tailed p-value, which is incorrect.\nD would be 10.0121 - 0.012, which would be the p-value if the sample mean had been above 50.

Question 11

A clinical trial is conducted to see if a new medication reduces cholesterol levels. After the trial, a hypothesis test yields a p-value of 0.048. The pre-determined significance level for the study was α=0.05\alpha = 0.05. Which of the following is the most appropriate and nuanced conclusion?

  1. The medication is proven to be effective, as the p-value is clearly less than 0.05.
  2. The p-value of 0.048 is less than 0.05, so the null hypothesis is rejected. This provides statistically significant evidence that the medication is effective. (correct answer)
  3. The result is not practically meaningful because the p-value of 0.048 is only slightly below the threshold of 0.05.
  4. Since p < 0.05, we can accept the alternative hypothesis that the medication is effective as fact.
Explanation: Statistical conclusions should be stated with appropriate language. Since p (0.048) < α\alpha (0.05), the result is statistically significant, and we reject the null hypothesis. Option B correctly uses the phrases 'statistically significant evidence' and 'reject the null hypothesis'.\nA and D use overly strong words like 'proven' and 'accept...as fact'. Hypothesis testing provides evidence, not proof.\nC confuses statistical significance with practical significance. A result is statistically significant if p < α\alpha, regardless of how close it is to the threshold. Whether the effect is large enough to be practically meaningful is a separate question.

Question 12

A coffee shop claims the average volume of its espresso shots is 30.0 mL. A consumer group measures a random sample of 15 shots and finds a mean volume of 29.2 mL with a sample standard deviation of 1.5 mL. A 99% confidence interval is constructed for the true mean volume. Based on this interval, is the coffee shop's claim plausible?

  1. Yes, the claim is plausible because the 99% confidence interval is approximately [28.05, 30.35], which contains 30.0 mL. (correct answer)
  2. No, the claim is not plausible because the sample mean of 29.2 mL is significantly less than 30.0 mL.
  3. Yes, the claim is plausible because the interval is approximately [28.52, 29.88], which is very close to 30.0 mL.
  4. No, the claim is not plausible because a 99% confidence interval is too wide to make a reliable conclusion.
Explanation: Using a graphing calculator or statistical software to find the t-interval for a mean with xˉ=29.2\bar{x}=29.2, s=1.5s=1.5, n=15n=15, and a confidence level of 0.99, we get the interval [28.05, 30.35]. Since the claimed mean of 30.0 mL is within this interval, we consider the claim plausible at the 99% confidence level. We do not have sufficient evidence to reject it.\nB is incorrect because it relies only on the sample mean and ignores sampling variability, which the confidence interval accounts for.\nC uses an incorrect interval, possibly calculated with a 90% confidence level, which would be [28.52, 29.88]. This interval does not contain 30.0, leading to an incorrect conclusion.\nD is incorrect because the width of the interval is a result of the data's variability and the high confidence level, but it does not invalidate the conclusion drawn from it.

Question 13

A coffee shop claims the average volume of its espresso shots is 30.0 mL. A consumer group measures a random sample of 15 shots and finds a mean volume of 29.2 mL with a sample standard deviation of 1.5 mL. A 99% confidence interval is constructed for the true mean volume. Based on this interval, is the coffee shop's claim plausible?

  1. Yes, the claim is plausible because the 99% confidence interval is approximately [28.05, 30.35], which contains 30.0 mL. (correct answer)
  2. No, the claim is not plausible because the sample mean of 29.2 mL is significantly less than 30.0 mL.
  3. Yes, the claim is plausible because the interval is approximately [28.52, 29.88], which is very close to 30.0 mL.
  4. No, the claim is not plausible because a 99% confidence interval is too wide to make a reliable conclusion.
Explanation: Using a graphing calculator or statistical software to find the t-interval for a mean with xˉ=29.2\bar{x}=29.2, s=1.5s=1.5, n=15n=15, and a confidence level of 0.99, we get the interval [28.05, 30.35]. Since the claimed mean of 30.0 mL is within this interval, we consider the claim plausible at the 99% confidence level. We do not have sufficient evidence to reject it.\nB is incorrect because it relies only on the sample mean and ignores sampling variability, which the confidence interval accounts for.\nC uses an incorrect interval, possibly calculated with a 90% confidence level, which would be [28.52, 29.88]. This interval does not contain 30.0, leading to an incorrect conclusion.\nD is incorrect because the width of the interval is a result of the data's variability and the high confidence level, but it does not invalidate the conclusion drawn from it.

Question 14

A pharmaceutical company has developed a new drug to reduce blood pressure. The current standard drug reduces systolic blood pressure by an average of 15 mmHg. The company wants to test if the new drug is more effective than the standard drug. Let μ\mu be the true mean reduction in systolic blood pressure for the new drug. How should the null and alternative hypotheses be formulated?

  1. H0:μ=15H_0: \mu = 15, H1:μ15H_1: \mu \neq 15
  2. H0:μ=15H_0: \mu = 15, H1:μ>15H_1: \mu > 15 (correct answer)
  3. H0:μ>15H_0: \mu > 15, H1:μ15H_1: \mu \leq 15
  4. H0:μ15H_0: \mu \leq 15, H1:μ>15H_1: \mu > 15
Explanation: The null hypothesis (H0H_0) is a statement of no effect or no difference, and it always contains the equality. In this case, it's that the new drug has the same effectiveness as the old one, so H0:μ=15H_0: \mu = 15. The alternative hypothesis (H1H_1) is what the researchers want to find evidence for, which is that the new drug is more effective. A greater reduction in blood pressure means a value larger than 15. Therefore, the alternative hypothesis is H1:μ>15H_1: \mu > 15. This is a one-tailed (right-tailed) test.\nA describes a two-tailed test, which would check if the drug is simply different (more or less effective).\nC and D incorrectly place the inequality in the null hypothesis.

Question 15

A study is conducted to compare the performance of two types of running shoes, A and B. Ten runners are selected, and each runner completes a 5 km run with shoe A and, on a different day, a 5 km run with shoe B. The times are recorded. A paired t-test is performed to see if there is a significant difference in running times. The resulting p-value is 0.027. Using a 5% significance level, what is the most appropriate conclusion?

  1. At the 5% significance level, there is not enough evidence to conclude a difference in mean running times between the two shoe types.
  2. The p-value of 0.027 means there is a 2.7% chance that the null hypothesis of no difference is true.
  3. At the 5% significance level, there is sufficient evidence to suggest a significant difference in mean running times between the two shoe types. (correct answer)
  4. An unpaired t-test should have been used because there are two different types of shoes, so the conclusion is invalid.
Explanation: The significance level is α=0.05\alpha = 0.05. The p-value is 0.027. Since the p-value (0.027) is less than the significance level (0.05), we reject the null hypothesis. Rejecting the null hypothesis means we have found statistically significant evidence of a difference. Therefore, there is sufficient evidence to suggest a difference in mean running times.\nA is incorrect because p < α\alpha.\nB is a common misinterpretation of the p-value. The p-value is the probability of observing the data (or more extreme data) if the null hypothesis were true, not the probability that the null hypothesis is true.\nD is incorrect because the study design, where each runner tests both shoes, is a classic example of a paired design. A paired t-test is the appropriate choice.

Question 16

A farmer tests two new types of fertilizer, FertiMax and GrowFast, on separate, randomly assigned plots of corn. The yield in kg is recorded. For 20 plots using FertiMax, the mean yield was 450 kg with a standard deviation of 30 kg. For 22 plots using GrowFast, the mean yield was 475 kg with a standard deviation of 35 kg. A two-sample t-test is conducted to determine if there is a significant difference in mean yields. What is the approximate p-value for this test?

  1. 0.008
  2. 0.015 (correct answer)
  3. 0.052
  4. 0.985
Explanation: This scenario involves two independent samples, so a two-sample t-test is appropriate. The hypotheses are H0:μ1=μ2H_0: \mu_1 = \mu_2 and H1:μ1μ2H_1: \mu_1 \neq \mu_2 (a two-tailed test). Using a graphing calculator's two-sample t-test function with the following inputs: xˉ1=450\bar{x}_1 = 450, s1=30s_1 = 30, n1=20n_1 = 20, xˉ2=475\bar{x}_2 = 475, s2=35s_2 = 35, n2=22n_2 = 22, and selecting the 'unpooled' option, the calculator gives a p-value of approximately 0.015.\nA, 0.008, is approximately the p-value for a one-tailed test (p/2), which would be incorrect as the question asks for a 'significant difference', implying a two-tailed test.\nC is an incorrect calculation.\nD would be derived from 1p1-p, which is not how p-values are interpreted in this context.

Question 17

A company manufactures bolts and uses a hypothesis test to check if the mean diameter meets the specification of 8.00 mm. The null hypothesis is H0:μ=8.00H_0: \mu = 8.00. They set the significance level α\alpha to 0.01. What is the meaning of this significance level?

  1. It is the probability that any given bolt has a diameter of exactly 8.00 mm.
  2. It is the probability of concluding the mean diameter is not 8.00 mm when it actually is 8.00 mm. (correct answer)
  3. It is the probability of failing to detect that the mean diameter is actually not 8.00 mm.
  4. It means that 99% of the manufactured bolts will meet the specification.
Explanation: The significance level, α\alpha, is the probability of making a Type I error. A Type I error is the rejection of a true null hypothesis. In this context, the null hypothesis is that the mean diameter is 8.00 mm. Rejecting this hypothesis means concluding the mean diameter is not 8.00 mm. Therefore, α=0.01\alpha = 0.01 is the probability of concluding the mean is not 8.00 mm when, in fact, it is.\nA is an incorrect interpretation of probability in this context.\nC describes the probability of a Type II error (β\beta).\nD confuses the significance level of a hypothesis test with a statement about the proportion of individual items meeting a specification.

Question 18

A psychologist is studying reaction times for a specific task. They collect data from a sample of 8 participants. The data contains a significant outlier and the distribution appears to be heavily skewed. A one-sample t-test is performed to compare the mean reaction time to a known value. The p-value is 0.04. What is the most significant concern about this conclusion?

  1. The sample size is too large for a t-test, and a z-test should have been used.
  2. The p-value is less than 0.05, so the conclusion of statistical significance is definitely valid and robust.
  3. The presence of an outlier and skewness in a small sample may invalidate the results of the t-test, which relies on an assumption of normality. (correct answer)
  4. A paired t-test should have been used instead of a one-sample t-test to account for the outlier.
Explanation: The t-test relies on the assumption that the underlying population is normally distributed, or that the sample size is large enough for the Central Limit Theorem to apply (typically n30n \geq 30). With a very small sample size (n=8n=8), the test is not robust to violations of normality. The presence of a significant outlier and heavy skewness suggests the normality assumption is violated, which can make the p-value from the t-test unreliable.\nA is incorrect; t-tests are specifically for small samples.\nB is incorrect because it ignores the violation of the test's assumptions.\nD is incorrect because the problem describes a one-sample scenario, and changing the test type doesn't fix the data distribution issue.

Question 19

An e-commerce company runs an experiment on its website with 500,000 users to test a new 'buy' button color. The null hypothesis is that the new color has no effect on the click-through rate. The test yields a p-value of 0.0001, and the 95% confidence interval for the increase in click-through rate is [0.01%, 0.03%]. Which is the best interpretation of these results?

  1. The p-value is very small, so the new color is highly effective and should be implemented immediately.
  2. The confidence interval contains only positive values, which contradicts the small p-value, so the results are likely invalid.
  3. The result is statistically significant, but the magnitude of the effect is very small, so the business impact may not be meaningful. (correct answer)
  4. The sample size was too large, which artificially lowered the p-value; the study should be repeated with a smaller sample.
Explanation: This question tests the difference between statistical significance and practical significance. The very small p-value (<0.05) indicates a statistically significant result; we have strong evidence that the new button color has an effect. However, the confidence interval [0.01%, 0.03%] shows that the size of this effect is very small. An increase of just 0.01% might not be enough to justify the cost of making the change. Therefore, the result is statistically significant but may not be practically important.\nA ignores the small effect size shown by the confidence interval.\nB is incorrect; a CI for the difference that does not contain zero is consistent with a small p-value.\nD is incorrect. A large sample size gives more power to detect even small effects; it does not make the result 'artificial'.

Question 20

A researcher is conducting a one-sample t-test with the hypotheses H0:μ=100H_0: \mu = 100 and H1:μ>100H_1: \mu > 100. The sample mean is xˉ=105\bar{x} = 105 and the sample size is n=25n=25. If the sample standard deviation were larger, how would this affect the t-statistic and the p-value, assuming all other values remain constant?

  1. The t-statistic would decrease, and the p-value would decrease.
  2. The t-statistic would decrease, and the p-value would increase. (correct answer)
  3. The t-statistic would increase, and the p-value would decrease.
  4. The t-statistic would increase, and the p-value would increase.
Explanation: The formula for the t-statistic is t=xˉμ0s/nt = \frac{\bar{x} - \mu_0}{s / \sqrt{n}}. The sample standard deviation, ss, is in the denominator. If ss increases, the value of the entire denominator increases. This causes the value of the t-statistic to decrease. A smaller t-statistic indicates that the sample mean is fewer standard errors away from the null hypothesis value. This means the result is less surprising or less extreme. A less extreme result corresponds to a larger p-value. Therefore, the t-statistic would decrease, and the p-value would increase.