Least Squares Solutions - Linear Algebra
- For a least-squares solution , what is ?
- The orthogonal projection of onto , the closest point to in the column space.
- has columns and , and . What is the least-squares solution?
- . is the projection of , with error .
- has linearly independent columns and is orthogonal to . What is the least-squares solution?
- , because the projection of onto is the zero vector.
- If is consistent, what are its least-squares solutions?
- Exactly its ordinary solutions, with least-squares error .
- How many least-squares solutions does have when the columns of are linearly dependent?
- Infinitely many: they differ by vectors in , though all give the same .
- To which subspace is the residual orthogonal?
- : it is orthogonal to every column of .
- is the single column and . What is the least-squares solution ?
- , the mean of the entries of : .
- What is a least-squares solution of ?
- A vector that minimizes over all .
- What is an overdetermined linear system?
- One with more equations than unknowns; such systems are usually inconsistent, which is why least squares is used.
- When does have a unique least-squares solution for every ?
- When the columns of are linearly independent (equivalently, is invertible).
- What is the least-squares error of ?
- , the distance from to .
- has orthogonal columns and , and . What is the least-squares solution?
- . With orthogonal columns, , giving and .