Business Statistics Quiz: Communicating Findings
20 questions · exam conditions
0:00
Communicating FindingsQuestion 1 of 20

Using purchase history and demographic data, an analyst performs a k-means cluster analysis and identifies three key customer segments. Now, the analyst must present these segments to the marketing team to help them develop targeted campaigns.

What is the most effective and actionable strategy for communicating the results of this cluster analysis?

Present the final cluster centroids for each variable and the within-cluster sum of squares to demonstrate the statistical robustness of the segments.
Explain the mathematics of the k-means algorithm, including how it iteratively minimizes Euclidean distance to form the groups.
Provide a list of all customers and their assigned cluster number (1, 2, or 3) so the marketing team can see the exact group compositions.
Develop descriptive personas for each segment (e.g., 'Thrifty Families,' 'Urban Professionals'), highlighting their key purchasing behaviors, demographics, and motivations.
← Back to quizzes

Business Statistics Quiz

Business Statistics Quiz: Communicating Findings

Practice Communicating Findings in Business Statistics with focused quiz questions that help you check what you know, review explanations, and build confidence with test-style prompts.

What this quiz covers

This quiz focuses on Communicating Findings, giving you a quick way to practice the rules, question types, and explanations that matter most for Business Statistics.

How to use this quiz

Try each quiz question before looking at the correct answer. Use the explanations to review missed ideas, then come back to similar questions until the pattern feels familiar.

All questions

Question 1

Using purchase history and demographic data, an analyst performs a k-means cluster analysis and identifies three key customer segments. Now, the analyst must present these segments to the marketing team to help them develop targeted campaigns.

What is the most effective and actionable strategy for communicating the results of this cluster analysis?

  1. Present the final cluster centroids for each variable and the within-cluster sum of squares to demonstrate the statistical robustness of the segments.
  2. Explain the mathematics of the k-means algorithm, including how it iteratively minimizes Euclidean distance to form the groups.
  3. Provide a list of all customers and their assigned cluster number (1, 2, or 3) so the marketing team can see the exact group compositions.
  4. Develop descriptive personas for each segment (e.g., 'Thrifty Families,' 'Urban Professionals'), highlighting their key purchasing behaviors, demographics, and motivations. (correct answer)
Explanation: When presenting analytical results to business stakeholders, your primary goal is translating technical findings into actionable insights that non-technical audiences can understand and implement. This principle is especially crucial with cluster analysis, where raw statistical output means little without business context. Option D is correct because developing descriptive personas transforms abstract statistical clusters into concrete, memorable customer archetypes that marketing teams can immediately visualize and target. Names like "Thrifty Families" or "Urban Professionals" combined with behavioral descriptions create actionable profiles that directly inform campaign strategy, messaging, and channel selection. Option A fails because presenting cluster centroids and within-cluster sum of squares provides technical validation but offers no business insight. Marketing teams need to understand customer behaviors and motivations, not statistical measures of cluster quality. Option B is similarly misguided—explaining the k-means algorithm's mathematical mechanics doesn't help marketers develop campaigns or understand customer needs. Option C provides operational detail (customer assignments) but lacks the strategic insight needed for campaign development. A raw list of customer IDs and cluster numbers doesn't reveal what makes each segment unique or how to approach them. The key lesson here is audience awareness in business communication. Technical professionals often make the mistake of presenting statistical rigor when stakeholders need strategic clarity. Remember that effective business analytics isn't just about running sophisticated algorithms—it's about translating quantitative insights into qualitative understanding that drives decision-making. Always ask yourself: "What does this analysis mean for business action?"

Question 2

An analyst is preparing a one-page executive summary of a lengthy and complex statistical study on market-entry strategies. The intended audience is the company's board of directors, who have limited time and statistical expertise.

Which element is the most crucial for the analyst to include in this executive summary?

  1. Key business insight upfront, followed by 2-3 clear, actionable recommendations supported by main findings. (correct answer)
  2. A detailed methodology section with data sources, statistical tests, and verified model assumptions to establish credibility.
  3. A comprehensive list of analyzed variables with corresponding p-values to demonstrate analytical rigor and thoroughness.
  4. An abstract of the research question with compelling highlights that direct readers to the full detailed report.
Explanation: When presenting statistical analysis to executives, you must prioritize audience needs over analytical completeness. Executive summaries serve a specific purpose: enabling quick, informed decision-making by busy leaders with limited technical background. Answer A is correct because it follows the fundamental principle of executive communication: lead with impact, then support with evidence. Starting with key business insights immediately shows value, while 2-3 actionable recommendations give executives concrete next steps. This structure respects their time constraints and decision-making responsibilities, making the statistical work actionable rather than just informative. Answer B fails because detailed methodology, while important for credibility, overwhelms non-technical audiences and consumes precious space in a one-page summary. Executives typically trust that proper analysis was conducted without needing statistical verification details. Answer C makes the classic mistake of confusing rigor with relevance. A comprehensive variable list with p-values demonstrates analytical thoroughness but provides no business value to executives who need strategic direction, not statistical proof. Answer D treats the executive summary as merely a teaser for the full report, wasting the opportunity to provide immediate value. Executives often won't read the full report, so the summary must be self-contained and actionable. Study tip: Remember the "inverted pyramid" principle for business communication: most important information first, supporting details second. Executive audiences need conclusions and recommendations upfront, not the analytical journey that led to them.

Question 3

A university studies a new academic support program by offering it to students on a voluntary basis. At the end of the semester, they find that students who participated in the program had significantly higher average grades than students who did not.

When reporting that the program is associated with higher grades, what is the most significant limitation stemming from the study's design that must be communicated?

  1. Because participation was voluntary, there is a strong possibility of self-selection bias; more motivated and diligent students may have chosen to join the program. (correct answer)
  2. The sample size may have been too small to generalize the results to the entire student population.
  3. The study only lasted for one semester, so the long-term effects of the program on student success are unknown.
  4. The statistical test used might not have been appropriate if the distribution of grades was not normal.
Explanation: When evaluating research studies, you must always critically assess the study design to identify potential biases that could affect the validity of the conclusions. This question tests your ability to recognize the most serious threat to internal validity. The correct answer is A because voluntary participation creates a fundamental flaw called self-selection bias. When students choose whether to participate, those who volunteer likely differ systematically from those who don't. More motivated, organized, or academically concerned students are naturally drawn to support programs, while less engaged students avoid them. This means the two groups weren't equivalent from the start – the program participants may have achieved higher grades even without the intervention. You cannot determine if the program caused the improvement or if it simply attracted students who were already positioned for success. Option B is incorrect because sample size affects statistical power and generalizability, but it's not the most significant design flaw here. Even with adequate sample size, self-selection bias would still contaminate the results. Option C is wrong because while long-term effects are worth studying, the limitation of a short timeframe doesn't invalidate the current findings or represent a design flaw. Option D is incorrect because non-normal distributions can be addressed through appropriate statistical tests or transformations. This is a technical consideration, not a fundamental design problem. Study tip: When analyzing research designs, always ask "Were the comparison groups equivalent before the intervention?" Self-selection bias is one of the most common threats to valid causal conclusions in business and social science research.

Question 4

An analyst for a software company models the relationship between price and number of subscriptions sold using a log-log regression model: ln⁡(Subscriptions)=β0−1.2⋅ln⁡(Price)+ϵ\ln(\text{Subscriptions}) = \beta_0 - 1.2 \cdot \ln(\text{Price}) + \epsilon. The coefficient for ln⁡(Price)\ln(\text{Price}), -1.2, is statistically significant.

What is the correct way to explain the meaning of the -1.2 coefficient to the head of sales?

  1. For every $1 increase in price, the company will lose 1.2 subscriptions.
  2. The model proves that lowering the price is the most effective way to increase the number of subscriptions.
  3. The negative relationship between price and subscriptions is very strong, with a correlation of -1.2.
  4. The model indicates that a 1% increase in price is associated with a 1.2% decrease in the number of subscriptions sold, holding other factors constant. (correct answer)
Explanation: When you encounter a log-log regression model where both variables are transformed using natural logarithms, you're dealing with elasticity interpretation. The key insight is that coefficients in log-log models represent percentage changes, not absolute unit changes. In the model ln⁡(Subscriptions)=β0−1.2⋅ln⁡(Price)+ϵ\ln(\text{Subscriptions}) = \beta_0 - 1.2 \cdot \ln(\text{Price}) + \epsilon, the coefficient -1.2 tells us about the price elasticity of demand. Since both variables are logged, a 1% change in price corresponds to a 1.2% change in subscriptions in the opposite direction (due to the negative sign). This makes answer D correct - the model shows that a 1% price increase is associated with a 1.2% decrease in subscriptions. Answer A is wrong because it interprets the coefficient as if this were a simple linear regression without logarithms. The -1.2 doesn't refer to losing 1.2 subscriptions per $1 price increase. Answer B overstates what the model tells us - while it shows a negative relationship, regression models show association, not causation, and don't prove what's "most effective" without comparing other strategies. Answer C confuses the regression coefficient with correlation - correlation values must fall between -1 and +1, so -1.2 is impossible as a correlation coefficient. Remember: In log-log regressions, coefficients represent elasticities - the percentage change in the dependent variable for a 1% change in the independent variable. This interpretation is crucial for business applications where managers think in terms of percentage changes rather than absolute units.

Question 5

A quality control manager analyzed defect rates across four production shifts and found significant differences (F = 8.23, p = 0.003). The analysis revealed that night shift workers had a 12% defect rate compared to 6% for day shifts. However, the study period coincided with the implementation of new equipment training, which was completed earlier for day shift workers.

When presenting these findings to senior management, which communication approach best addresses the primary analytical limitation?

  1. Report the findings as preliminary due to the confounding variable of training timing, and recommend a follow-up analysis after training completion. (correct answer)
  2. Present the statistical significance as strong evidence of shift-based performance differences while recommending immediate staffing adjustments for night shifts.
  3. Focus on the practical significance of the 6% difference in defect rates while noting that statistical significance confirms the reliability of this finding.
  4. Emphasize the robust F-statistic and low p-value as indicators that shift assignment is the primary driver of quality differences across the organization.
Explanation: When interpreting statistical results for business decisions, you must always consider confounding variables that could invalidate your conclusions, even when the statistics appear strong and significant. The correct answer is A because it properly identifies the critical flaw in this analysis: the timing of equipment training creates a confounding variable. Since day shift workers completed training earlier than night shift workers, you cannot determine whether the defect rate differences are due to shift assignment or training status. The significant F-statistic only tells you that differences exist between groups—it doesn't prove causation or identify the true underlying cause. Option B is wrong because it treats correlation as causation, ignoring the confounding variable and potentially leading to harmful staffing decisions based on flawed analysis. Option C incorrectly suggests that statistical significance validates the finding's reliability when a confounding variable is present—statistical significance doesn't eliminate threats to internal validity. Option D makes the same causation error as B, attributing the differences to shift assignment when the training variable provides an equally plausible explanation. Remember that statistical significance only indicates that observed differences are unlikely due to random chance—it doesn't prove your hypothesized cause is correct. Always examine the study design for confounding variables that could offer alternative explanations. In business statistics, premature conclusions based on incomplete analysis can lead to costly organizational decisions, so acknowledging limitations and recommending follow-up studies demonstrates sound analytical thinking.

Question 6

A market researcher reports that Brand X has significantly higher customer loyalty than Brand Y (p = 0.02), based on analyzing customer retention rates from loyalty program databases. When pressed for details, the researcher reveals that Brand X customers averaged 3.2 years in the program versus 2.8 years for Brand Y customers. What is the most important limitation to communicate about this finding?

  1. The 0.4-year difference, while statistically significant, may not represent a meaningful business advantage given the variability in customer loyalty measurement.
  2. Statistical significance at p = 0.02 provides only weak evidence of difference and should be interpreted cautiously for strategic business decisions.
  3. Loyalty program participation represents a biased sample that may not reflect broader customer loyalty patterns across all brand customers. (correct answer)
  4. The retention time measurement confounds customer loyalty with program tenure, as longer-tenured customers naturally show higher retention rates.
Explanation: The sampling bias is the most critical limitation. Loyalty program participants represent a self-selected group that likely differs systematically from the broader customer base in their engagement and loyalty patterns. This makes it impossible to generalize findings to all customers of each brand. Choice A addresses effect size but misses the fundamental sampling issue. Choice B incorrectly suggests p = 0.02 is weak evidence. Choice D confuses the measurement with a different analytical issue about tenure effects.

Question 7

A retail chain's data science team analyzed customer purchase patterns and developed a model predicting customers likely to churn within 90 days. The model correctly identified 82% of customers who actually churned (sensitivity) and correctly identified 76% of customers who stayed (specificity). The team presents this as a 'highly accurate model ready for deployment.'

Based on the information provided, what critical limitation should be highlighted before deploying this model operationally?

  1. The sensitivity of 82% means 18% of churning customers will be missed, potentially resulting in significant revenue loss from unidentified at-risk customers.
  2. The specificity of 76% indicates high false positive rates that could waste resources on retention efforts for customers who weren't planning to leave.
  3. Without knowing the actual churn rate in the population, it's impossible to assess the model's overall accuracy or positive predictive value for business use. (correct answer)
  4. The difference between sensitivity and specificity suggests model bias that requires rebalancing before implementation in customer retention programs.
Explanation: Without knowing the base churn rate, stakeholders cannot assess practical performance. If churn rate is very low (e.g., 5%), even high sensitivity/specificity can result in poor positive predictive value, meaning most 'churn predictions' would be false alarms. This base rate information is essential for operational planning. Choice A identifies a real concern but focuses only on missed churners. Choice B addresses false positives but isn't the most fundamental limitation. Choice D incorrectly suggests that different sensitivity/specificity values necessarily indicate bias requiring correction.

Question 8

A financial analyst presents survey results showing that 78% of respondents plan to increase spending next quarter, with a margin of error of ±4% at 95% confidence. A colleague questions why the analyst didn't also report the 22% planning to decrease or maintain spending. How should the analyst respond to best communicate the completeness of the findings?

  1. Explain that the 22% represents sampling error and should not be reported separately since it falls within the margin of error bounds.
  2. Clarify that the 22% includes both those planning to decrease spending and those planning to maintain current levels, which represent different behavioral intentions.
  3. Note that reporting the complement percentage is redundant since stakeholders can calculate 100% - 78% = 22% independently when needed.
  4. Acknowledge that the 22% should be broken down into decrease vs. maintain categories, as this distinction is crucial for economic forecasting purposes. (correct answer)
Explanation: The analyst should acknowledge that combining 'decrease' and 'maintain' into a single 22% category masks important distinctions for economic analysis. Those planning to decrease spending have different economic implications than those maintaining current levels. This breakdown is essential for accurate interpretation and forecasting. Choice A incorrectly confuses the complement percentage with sampling error. Choice B identifies the issue but doesn't recommend the necessary action. Choice C dismisses the importance of the breakdown for analytical purposes.

Question 9

A data analyst reports: 'Our regression model explains 85% of the variance in sales revenue (R² = 0.85, p < 0.001), with advertising spend as the strongest predictor (β = 0.72, p < 0.001).' When communicating these findings to non-technical stakeholders, which aspect requires the most careful clarification to avoid misinterpretation?

  1. The distinction between statistical significance and practical business significance, emphasizing that p-values don't indicate effect magnitude or business impact.
  2. The difference between correlation and causation, clarifying that the model shows association but doesn't prove advertising causes sales increases. (correct answer)
  3. The meaning of R², explaining that 85% represents model fit quality rather than prediction accuracy for individual future sales forecasts.
  4. The interpretation of beta coefficients, noting that 0.72 represents standardized units rather than actual dollar-for-dollar advertising returns.
Explanation: The correlation vs. causation distinction is the most critical clarification needed because stakeholders are likely to interpret 'advertising spend as the strongest predictor' as proof that increasing advertising will cause sales increases. This misinterpretation could lead to poor business decisions. While A, C, and D are all important clarifications, they are more technical in nature and less likely to lead to fundamental strategic errors compared to assuming causation from correlation.

Question 10

A supply chain analyst conducted a regression analysis to predict delivery delays using weather data, traffic patterns, and seasonal factors. The model achieved R² = 0.73 with all predictors significant at p < 0.05. When presenting to operations managers, the analyst states: 'This model can predict delivery delays with 73% accuracy, allowing us to proactively adjust schedules and reduce customer complaints.'

What is the primary statistical misinterpretation that should be corrected in this presentation?

  1. R² represents explained variance in the data used to build the model, not prediction accuracy for future deliveries or operational scenarios. (correct answer)
  2. Statistical significance of predictors doesn't guarantee that the model will perform reliably under different seasonal or weather conditions than those in the training data.
  3. The model explains correlation between variables but cannot establish that weather and traffic actually cause delivery delays rather than being associated factors.
  4. Regression models provide point estimates rather than probability distributions, making it inappropriate to claim predictive accuracy without confidence intervals.
Explanation: The analyst incorrectly equates R² with prediction accuracy. R² measures how well the model fits the existing data used to build it, not how accurately it will predict future outcomes. This is a critical distinction for operational use. Choice B raises a valid concern about generalizability but doesn't address the specific R² misinterpretation. Choice C about causation is important but not the primary error in the statement. Choice D is incorrect because regression models can include prediction intervals, and the main issue is the R² interpretation.

Question 11

An e-commerce company runs an A/B test on a new, redesigned 'checkout' button. The new blue button is tested against the old red button on 1,000,000 users. The new button has a click-through rate (CTR) of 2.1%, while the old button has a CTR of 2.0%. The difference is statistically significant (p < 0.01). Implementing the new button requires a significant investment in development and user re-training.

As the data analyst, how should you communicate these findings to the product manager who must decide whether to launch the new button?

  1. The test was a success; the new blue button is statistically proven to be superior to the old one and should be implemented immediately to capitalize on the higher click-through rate.
  2. The difference in performance between the two buttons is negligible. Since the rates are only 0.1% apart, the statistical significance is misleading and the old button should be kept.
  3. The new blue button resulted in a statistically significant increase in the click-through rate. However, the effect size is a small absolute increase of 0.1%, which may not provide a sufficient business return to justify the implementation costs. (correct answer)
  4. The analysis demonstrates that the color blue causes users to click more than the color red. This insight can be applied to other buttons across the website to increase engagement.
Explanation: This is the most complete and balanced communication. It correctly states the statistical conclusion (significance) but immediately contextualizes it with the practical implication (small effect size) and connects it to the business decision (cost vs. benefit). This allows the product manager to make an informed choice. Distractor A ignores practical significance. Distractor B incorrectly dismisses statistical significance. Distractor D makes an unwarranted causal claim and over-generalizes the finding.

Question 12

A company sends a customer satisfaction survey to its entire database of 20,000 clients. Only 1,000 clients respond (a 5% response rate). The results from these 1,000 respondents show that 92% are 'Very Satisfied' with the company's services.

When presenting these findings, what is the most critical limitation the analyst must emphasize to management?

  1. The margin of error for a sample of 1,000 is approximately ±3%, which introduces some uncertainty into the 92% satisfaction figure.
  2. The wording of the survey questions could have been biased, leading customers to provide more positive feedback than they otherwise would have.
  3. The extremely low response rate suggests a high risk of non-response bias, where the respondents may not be representative of the entire customer base. (correct answer)
  4. The sample size of 1,000, while seemingly large, may not have enough statistical power to detect small but important differences among customer subgroups.
Explanation: With a 5% response rate, non-response bias is the most severe threat to the study's validity. It's highly likely that the customers who chose to respond are systematically different from the 19,000 who did not (e.g., they might be the most loyal or most disgruntled). This limitation is more fundamental than sampling error (A), measurement error (B), or statistical power (D).

Question 13

A manufacturing plant trials a new production process. After the trial, an analyst calculates a 95% confidence interval for the mean increase in units produced per hour. The resulting interval is [2.5, 8.5].

Which of the following is the best way to explain this result to a plant manager who is not a statistician?

  1. There is a 95% probability that the true average increase in production from the new process is between 2.5 and 8.5 units per hour.
  2. We can be 95% confident that the true average increase in production is between 2.5 and 8.5 units per hour. Because the entire interval is positive, we have strong evidence the new process is an improvement. (correct answer)
  3. If we implement the new process, 95% of our production hours will see an increase of between 2.5 and 8.5 units.
  4. The new process increases productivity by an average of 5.5 units per hour, and this estimate is certain to be within 3 units of the true value.
Explanation: This statement correctly interprets the confidence level ('we are 95% confident') and the interval itself as a range for the population mean. It also provides the key business takeaway: since the interval is entirely above zero, the effect is likely real. Distractor A incorrectly states the confidence level as a probability about the parameter. Distractor C misinterprets a confidence interval for a mean as a prediction interval for individual outcomes. Distractor D incorrectly implies certainty and focuses on the midpoint.

Question 14

A team of data scientists builds a very complex decision tree model to predict which customers are likely to cancel their subscriptions. On the data used to build the model (the training set), it correctly predicts outcomes for 99% of customers. When the model is tested on a new, unseen set of customers (the test set), its accuracy drops to 70%.

What is the most important conclusion the team must communicate to business leaders about the model's readiness for deployment?

  1. The model is highly successful, with 99% accuracy, and should be deployed immediately to begin saving customers.
  2. The model's performance on the test set (70%) is its true expected performance, and it is likely overfit to the training data, meaning it may not be reliable in practice. (correct answer)
  3. The significant drop in accuracy suggests that the test data was of poor quality or from a different time period, which is why the model performed poorly on it.
  4. The model's true accuracy is likely the average of the two results, approximately 85%, which is excellent for a predictive model.
Explanation: The large gap between training accuracy (99%) and test accuracy (70%) is a classic sign of overfitting. The test set performance is the honest estimate of how the model will perform on new data. Communicating this is crucial for setting correct expectations. Distractor A is a dangerous conclusion that ignores the test results. Distractor C blames the data rather than the model, which is a less likely explanation for such a large performance gap. Distractor D is incorrect; averaging the two accuracies has no statistical basis.

Question 15

A business consultant analyzed productivity data and found that remote workers completed 8% more tasks than office workers (95% CI: 2% to 14%, p = 0.008). When presenting to a client considering remote work policies, which aspect of uncertainty should be communicated most clearly?

  1. The p-value of 0.008 indicates a small probability that the observed difference occurred by chance, but external factors may still explain the productivity gap.
  2. The confidence interval suggests the true productivity difference could be as small as 2%, which may not justify the costs of implementing remote work infrastructure.
  3. The 8% average increase represents a point estimate, and individual employee productivity changes will vary considerably around this central tendency.
  4. The statistical significance confirms a reliable difference exists, but the analysis cannot determine whether remote work causes productivity increases or productive workers choose remote options. (correct answer)
Explanation: This addresses the most critical uncertainty for business decision-making: the causal interpretation. Without establishing causation, the client cannot assume that implementing remote work policies will actually increase productivity. The difference might exist because more productive employees self-select into remote work arrangements. Choice A misinterprets what p-values represent. Choice B focuses on practical significance but misses the causal inference issue. Choice C addresses individual variation but isn't the most crucial uncertainty for policy decisions.

Question 16

A human resources department runs a regression analysis to understand the relationship between the number of hours an employee spends in optional training programs and their annual sales performance (in dollars). The analysis finds a strong, statistically significant positive coefficient for the TrainingHours variable.

Which statement is the most appropriate and precise way to communicate this finding in a report to management, avoiding common interpretation errors?

  1. Our analysis proves that investing more hours in employee training directly causes an increase in their annual sales performance.
  2. There is a significant positive association between training hours and sales performance, suggesting that employees with more training tend to have higher sales. (correct answer)
  3. For every additional hour of training an employee completes, their individual sales are guaranteed to increase by the amount of the regression coefficient.
  4. The model indicates that the most effective way to increase overall company sales is to make the optional training programs mandatory for all employees.
Explanation: This statement correctly uses correlational language ('association', 'tend to have') rather than making a causal claim. It accurately reflects the findings of a regression analysis without overstating them. Distractor A incorrectly claims causation. Distractor C misinterprets the regression coefficient as a deterministic, individual-level guarantee rather than an average tendency. Distractor D makes a business recommendation that goes beyond what the correlational data can support.

Question 17

An analyst performs a chi-square test of independence and finds a statistically significant (p < 0.001) association between a customer's region (North, South, East, West) and the product category they purchase most frequently (Electronics, Apparel, Home Goods).

When communicating this result, what is a common misinterpretation that the analyst must be careful to prevent?

  1. Concluding that because the p-value is very low, the strength of the association between region and product preference must be very strong. (correct answer)
  2. Stating that a customer's region causes them to prefer a certain product category.
  3. Forgetting to report the degrees of freedom for the test, which is essential context for the chi-square value.
  4. Assuming the samples from each region were of equal size, which is a required condition for the test.
Explanation: When interpreting chi-square test results, you need to distinguish between statistical significance and effect size. These are completely different concepts that students often confuse. A very low p-value (like p < 0.001) only tells you that the association is unlikely due to chance—it doesn't measure how strong that association actually is. Statistical significance depends heavily on sample size: with a large enough dataset, even tiny, practically meaningless associations will produce highly significant p-values. The strength of association is measured by effect size statistics like Cramér's V, not the p-value. Option A correctly identifies this common misinterpretation. A p-value of 0.001 means there's strong evidence of some association, but that association could be quite weak in practical terms. Option B describes a correlation-versus-causation error, which is serious but not specifically related to misinterpreting p-values. Chi-square tests can never establish causation regardless of the p-value. Option C mentions degrees of freedom, which are important for interpretation but not reporting them isn't a misinterpretation of the results—it's an omission of technical details. Option D incorrectly suggests equal sample sizes are required. Chi-square tests can handle unequal group sizes without problems; this isn't a validity concern. Study tip: Always remember that p-values measure the strength of evidence against the null hypothesis, not the magnitude of the effect. When you see "statistically significant," immediately ask yourself: "But is it practically significant?" Look for effect size measures to answer that question.

Question 18

A large retail bank conducted a pilot study of a new mobile banking app feature with a sample of its high-net-worth clients in California. The study showed a 40% increase in user engagement and very high satisfaction scores. Based on this success, a senior vice president proposes an immediate, nationwide launch to all of the bank's customers.

What is the most important limitation the study's analyst must communicate to the vice president regarding the proposed nationwide launch?

  1. The study was observational, so we cannot be certain that the new feature caused the increase in engagement.
  2. The study's duration was only three months, which may not be long enough to assess the feature's long-term impact on user behavior.
  3. The Hawthorne effect may have been present, where participants changed their behavior simply because they were being observed in a study.
  4. The sample was limited to high-net-worth clients in one state, so the results may not be generalizable to the broader customer base, which has different demographics and needs. (correct answer)
Explanation: When evaluating research results for broader implementation, you must always assess whether the study sample adequately represents the target population. This question tests your understanding of external validity and generalizability in business research. The correct answer is D because the study's sample creates a serious generalizability problem. High-net-worth clients in California represent a very specific demographic with unique characteristics: higher income, potentially greater tech adoption, different banking needs, and specific regional preferences. These clients may respond very differently to mobile features compared to the bank's broader customer base, which likely includes middle-income customers, seniors, rural clients, and people from diverse geographic regions with varying tech comfort levels. Rolling out based on this narrow sample could lead to disappointing results or even customer dissatisfaction among different demographic groups. While A raises a valid point about causation versus correlation, the passage doesn't suggest this is the primary concern for implementation decisions. B identifies a legitimate timing issue, but three months is often sufficient for initial engagement assessment. C correctly identifies the Hawthorne effect as a potential bias, but this psychological phenomenon typically affects all participants similarly and wouldn't necessarily invalidate positive results. The key lesson here: always examine who was studied versus who will be affected by the decision. Look for demographic, geographic, or behavioral differences between the sample and target population. On business statistics exams, questions about generalizing research results often hinge on sample representativeness rather than technical statistical issues.

Question 19

An HR analytics team studied employee satisfaction scores before and after implementing flexible work arrangements. Using a paired t-test on 85 employees, they found a statistically significant improvement (t = 3.47, p = 0.001) with mean satisfaction increasing from 6.2 to 6.8 on a 10-point scale. However, 23 employees left the company during the study period and were excluded from the analysis.

Which limitation should be emphasized most prominently when communicating these findings to executive leadership?

  1. The effect size of 0.6 points on a 10-point scale may not represent a practically meaningful improvement in actual employee satisfaction levels.
  2. The exclusion of employees who left creates potential survivorship bias, as those remaining may be inherently more satisfied with any policy changes. (correct answer)
  3. The paired t-test assumes normally distributed differences, which may not hold for satisfaction scores measured on ordinal scales rather than continuous scales.
  4. The study design lacks a control group of employees without flexible arrangements, making it impossible to isolate the policy's specific impact from other factors.
Explanation: Survivorship bias is the most critical limitation because excluding departing employees could fundamentally skew results. Those who stayed may be predisposed to rate any changes more favorably, while those who left (possibly due to dissatisfaction with the changes) aren't represented in the analysis. This bias could lead executives to overestimate policy effectiveness. Choice A raises a valid point about effect size but is less fundamental. Choice C is too technical for executive communication. Choice D is incorrect because the study uses a before-after design with the same subjects, not a control group comparison.

Question 20

A marketing research firm conducted a study on consumer preferences for a new product line. The study used a convenience sample of 150 customers from three retail locations in urban areas. The analysis showed a statistically significant preference (p < 0.05) for Product A over Product B, with 68% of respondents choosing Product A. The research team plans to present these findings to support a nationwide product launch strategy.

Which statement best describes the most critical limitation that should be communicated when presenting these findings?

  1. The sample size of 150 is insufficient to detect meaningful differences between products, requiring a larger study before making business decisions.
  2. The convenience sampling method from urban locations only limits generalizability to the broader target population for a nationwide launch. (correct answer)
  3. The statistical significance level of p < 0.05 is too conservative and should be adjusted to p < 0.10 for business applications.
  4. The 68% preference rate is too close to random chance to provide meaningful guidance for product development strategies.
Explanation: The most critical limitation is the convenience sampling from only urban locations, which severely limits the ability to generalize findings to a nationwide population that includes rural, suburban, and diverse demographic areas. This sampling bias is fundamental to the validity of applying results to a broader launch strategy. Choice A is incorrect because 150 is generally adequate for detecting meaningful differences. Choice C is wrong because p < 0.05 is the standard significance level, not too conservative. Choice D is incorrect because 68% represents a substantial preference, not random chance (which would be 50%).