Correlation & Regression - IB Mathematics Analysis and Approaches
- The correlation coefficient between the height (in cm) and weight (in kg) of a group of students is calculated to be . If the heights are converted to metres (by dividing by 100) and the weights are converted to grams (by multiplying by 1000), what will be the new correlation coefficient? Answer: 0.78 Pearson's product-moment correlation coefficient (r) is a dimensionless quantity and is unaffected by linear transformations (such as changing units) of the variables. Therefore, converting height from cm to m and weight from kg to g will not change the value of .
- The correlation coefficient between hours spent exercising per week () and body fat percentage () is found to be . What percentage of the variation in body fat percentage can be explained by the linear relationship with hours spent exercising? Answer: 64% When you encounter correlation coefficient problems in IB Mathematics, remember that the correlation coefficient tells you about the strength and direction of a linear relationship, but to find the percentage of variation explained, you need the coefficient of determination, which is . The coefficient of determination represents what percentage of the variation in the dependent variable (body fat percentage) can be explained by the linear relationship with the independent variable (hours exercising). Here, , so . Notice that we square the correlation coefficient, which always gives a positive result regardless of whether the original correlation was positive or negative. Looking at the wrong answers: Choice A (-80%) is impossible because percentages of variation explained cannot be negative - is always positive since it's a squared value. Choice B (36%) likely comes from incorrectly calculating or some other computational error. Choice C (80%) is the trap of using the absolute value of directly instead of squaring it - this is a very common mistake. The key insight is that correlation and explained variation are different concepts. A correlation of -0.8 indicates a strong negative relationship, but to find explained variation, you must square this value. Study tip: Always remember for explained variation questions. The sign of tells you direction, but tells you explanatory power. This distinction appears frequently on IB exams.
- A scatter plot of variables and shows a perfect parabolic relationship, defined by for values symmetrically distributed around 0 (e.g., from -5 to 5). The Pearson's product-moment correlation coefficient is calculated for this data. Which value is the most likely for ? Answer: Pearson's correlation coefficient measures the strength and direction of a linear relationship. For the function over a symmetric interval like [-5, 5], there is a perfect non-linear relationship. For every positive value of that suggests a positive trend, there is a corresponding negative value of that suggests a negative trend. These effects cancel each other out, resulting in a correlation coefficient of exactly 0. This highlights that means no linear correlation, not necessarily no relationship at all.
- A biologist models the relationship between the length of a fish ( cm) and its weight ( g). The data was collected for fish with lengths between 10 cm and 30 cm. The resulting regression line is and the correlation coefficient is . The biologist wants to estimate the weight of a fish that is 5 cm long. Which statement is the most appropriate? Answer: The estimate is unreliable because it involves extrapolation. The data used to create the model was for fish with lengths between 10 cm and 30 cm. Using the model to predict the weight for a fish of 5 cm length is an example of extrapolation, as it is outside the range of the original data. Predictions made by extrapolation are considered unreliable, regardless of how strong the correlation coefficient is. While correlation doesn't imply causation (D), the primary reason for unreliability here is extrapolation.
- The regression line for the number of ice creams sold () versus the daily temperature ( in degrees Celsius) is . The data was collected for temperatures between and . What is the most appropriate interpretation of the -intercept? Answer: The model is likely not valid for a temperature of as this represents a significant extrapolation from the data range. The -intercept is the value of when . In this model, the intercept is -50. However, the data was collected for temperatures between and . A temperature of is far outside this range. Interpreting the intercept is an act of extrapolation, and therefore the model is not reliable at this value. Choice A is a literal interpretation but B provides the better statistical reason why that interpretation is flawed.
- Consider three distinct bivariate datasets. Dataset A has a correlation coefficient of . Dataset B has a correlation coefficient of . Dataset C has a correlation coefficient of . Which statement correctly compares the strength of the linear relationships? Answer: Dataset B has the strongest relationship. The strength of a linear correlation is determined by the absolute value of the correlation coefficient, . A value closer to 1 or -1 indicates a stronger linear relationship. We compare the absolute values: , , and . Since 0.9 is the largest value, Dataset B has the strongest linear relationship. Dataset C has the weakest.
- A researcher finds the Pearson's product-moment correlation coefficient between two variables, and , is . Which of the following statements is the most accurate interpretation of this result? Answer: There is a strong negative linear correlation between and , and as increases, tends to decrease. The value of indicates the strength and direction of a linear correlation. A value close to -1, such as -0.95, indicates a very strong negative linear correlation. This means that as one variable increases, the other variable tends to decrease. Correlation does not imply causation, so a causal link cannot be established from the value alone.
- The equation of the regression line of on for a dataset is given by . The mean of the -values is . What is the mean of the -values, ? Answer: 11 A key property of the least squares regression line is that it always passes through the point of means, . Therefore, the coordinates of the mean point must satisfy the equation of the line. We can substitute into the equation to find : .
- For a dataset, the regression line of on is . The mean of the -values is . Use the regression line to predict the value of when . Answer: 8.4 To predict the value of for a given , substitute the value of into the regression equation. Here, we substitute : . The information about the mean is extra information not needed for this specific calculation, though it can be used to find (which is 9.8, a distractor).
- For a set of data, the regression line of the price of a used car (, in thousands of dollars) on its age (, in years) is given by . What is the best interpretation of the gradient of this line? Answer: For every year older a car is, its price is expected to decrease by $1800. The gradient (slope) of the regression line represents the change in the dependent variable (Price) for a one-unit increase in the independent variable (Age). Here, the gradient is -1.8. Since the price is in thousands of dollars, a gradient of -1.8 means that for each additional year of age, the price is expected to decrease by 1.8 thousand dollars, which is $1800.
- The least squares regression line of on is determined for a set of data points. Which of the following quantities does this line minimize? Answer: The sum of the squares of the vertical distances from the points to the line. When you encounter questions about least squares regression, remember that this method gets its name from literally minimizing the sum of squared residuals. Understanding what "residual" means is key to answering this correctly. The least squares regression line is positioned to minimize the sum of the squares of the vertical distances from each data point to the line. These vertical distances are called residuals - they represent the difference between the actual y-value and the predicted y-value for each x. The line is called "least squares" because it finds the position where is minimized, where is the actual value and is the predicted value. Answer D correctly identifies this fundamental principle of least squares regression. Answer A is incorrect because regression minimizes vertical distances, not horizontal ones. Horizontal distances would be relevant if we were regressing x on y instead. Answer B describes minimizing the maximum distance (a "minimax" approach), which is a completely different optimization criterion not used in least squares regression. Answer C refers to minimizing the sum of absolute values of vertical distances, which describes a different type of regression called "least absolute deviations" or "robust regression." This method is less sensitive to outliers but is not what least squares does. Remember this connection: "least squares" = minimizing the sum of squared vertical distances. The squaring serves two purposes: it eliminates negative values (since we want total deviation) and it penalizes larger deviations more heavily than smaller ones.
- A dataset on study hours () and exam scores () shows a strong positive correlation. A data point is found to be a data entry error and is corrected to . Assuming this corrected point better fits the linear trend of the other data points, what is the likely effect of this correction on the correlation coefficient and the gradient of the regression line? Answer: will increase and the gradient will increase. The original point is an influential outlier in the -direction. It has high leverage and would pull the regression line towards it, making the line less steep (decreasing the gradient) than it otherwise would be. It also lies far from the general linear trend, weakening the correlation (decreasing ). Correcting this point to , which is assumed to fit the trend, removes the outlier's influence. As a result, the line will become steeper (the gradient increases) and the points will be more tightly clustered around the line (the correlation becomes stronger, so increases).
- For a bivariate dataset, the following summary statistics are given: , , , , and . Find the equation of the regression line of on , in the form . Answer: The gradient of the regression line on is given by . So, . The line passes through the mean point . We calculate the means: and . Now we find the y-intercept using . Substituting the values: . Thus, the equation is .
- The equation of the regression line of on is . The line passes through the point and the mean point . Find the value of . Answer: 3 This is a two-step problem. First, use the fact that the line passes through to find the constant . Substitute and into the equation: . So, the full equation of the regression line is . Second, use the property that the regression line must pass through the mean point . Substitute into the equation: .
- For two variables and , the regression line of on has a negative gradient. Which of the following statements about the Pearson's product-moment correlation coefficient must be true? Answer: The gradient of the regression line is calculated as . The correlation coefficient is . Since and are always non-negative, the sign of both and is determined by the sign of . Therefore, if the gradient is negative, must be negative, and thus must also be negative.