Linear Regression via Least Squares - Linear Algebra
- Which point does a least-squares line (with intercept) always pass through?
- , the point of means of the data.
- With design matrix and observations , what system gives the regression coefficients ?
- .
- What is the sum of the residuals for a least-squares line that includes an intercept?
- . The residual vector is orthogonal to the column of ones in the design matrix.
- Why can be fit by linear least squares?
- The model is linear in the parameters ; the design matrix rows are .
- In linear regression, what is the residual of data point ?
- The observed value minus the predicted value: .
- For the model , what is row of the design matrix?
- .
- Fit (no intercept) to and by least squares. What is ?
- . With one column, .
- Which quantity does the least-squares regression line minimize?
- The sum of the squared residuals, .
- For fitting to data , what is row of the design matrix?
- . The multiplies the intercept .
- What is the fitted intercept when is fit to , , ?
- . Since , the line passes through , and .
- What least-squares line fits , , ?
- . The points lie exactly on this line, so every residual is .
- What is the design matrix for fitting to , , ?
- , with observation vector .