Projections onto Lines & Subspaces - Linear Algebra

  1. What is the standard matrix of projection onto the line spanned by (1,1)(1, 1) in R2\mathbb{R}^2?
    [[12,12],[12,12]][[\frac{1}{2}, \frac{1}{2}], [\frac{1}{2}, \frac{1}{2}]] (rows), from 12uuT\frac{1}{2}\mathbf{u}\mathbf{u}^T with u=(1,1)\mathbf{u} = (1, 1).
  2. Why does the formula projWy=∑projuiy\text{proj}_W\mathbf{y} = \sum \text{proj}_{\mathbf{u}_i}\mathbf{y} require the basis {ui}\{\mathbf{u}_i\} to be orthogonal?
    Without orthogonality the summed line projections overlap and do not give the closest point in WW; the formula relies on ui⋅uj=0\mathbf{u}_i\cdot\mathbf{u}_j = 0.
  3. What is the formula for the orthogonal projection of y\mathbf{y} onto the line spanned by a nonzero u\mathbf{u}?
    projuy=y⋅uu⋅u u\text{proj}_\mathbf{u}\mathbf{y} = \frac{\mathbf{y}\cdot\mathbf{u}}{\mathbf{u}\cdot\mathbf{u}}\,\mathbf{u}.
  4. If {u1,…,uk}\{\mathbf{u}_1, \dots, \mathbf{u}_k\} is an orthogonal basis of WW, what is projWy\text{proj}_W\mathbf{y}?
    ∑i=1ky⋅uiui⋅ui ui\sum_{i=1}^{k} \frac{\mathbf{y}\cdot\mathbf{u}_i}{\mathbf{u}_i\cdot\mathbf{u}_i}\,\mathbf{u}_i, the sum of the projections onto each basis line.
  5. If QQ has orthonormal columns, what is the matrix of orthogonal projection onto Col Q\text{Col}\,Q?
    QQTQQ^T. It is A(ATA)−1ATA(A^TA)^{-1}A^T with QTQ=IQ^TQ = I.
  6. What is the projection of (4,1,5)(4, 1, 5) onto W=span{(1,0,0),(0,1,1)}W = \text{span}\{(1, 0, 0), (0, 1, 1)\}?
    (4,3,3)(4, 3, 3). The basis is orthogonal, so add 4(1,0,0)4(1, 0, 0) and 1+52(0,1,1)\frac{1 + 5}{2}(0, 1, 1).
  7. What is the standard matrix of projection onto the line y=2xy = 2x in R2\mathbb{R}^2?
    [[15,25],[25,45]][[\frac{1}{5}, \frac{2}{5}], [\frac{2}{5}, \frac{4}{5}]] (rows), from uuT5\frac{\mathbf{u}\mathbf{u}^T}{5} with u=(1,2)\mathbf{u} = (1, 2).
  8. What is the projection of (1,2,3)(1, 2, 3) onto the line spanned by (1,0,1)(1, 0, 1)?
    (2,0,2)(2, 0, 2). The scalar is 1+0+32=2\frac{1 + 0 + 3}{2} = 2.
  9. What is the projection of (2,3)(2, 3) onto the line spanned by (1,1)(1, 1)?
    (52,52)(\frac{5}{2}, \frac{5}{2}). The scalar is 2+31+1=52\frac{2 + 3}{1 + 1} = \frac{5}{2}.
  10. What is the standard matrix of orthogonal projection onto the line spanned by a nonzero u\mathbf{u} in Rn\mathbb{R}^n?
    uuTuTu\frac{\mathbf{u}\mathbf{u}^T}{\mathbf{u}^T\mathbf{u}}, an n×nn \times n matrix of rank 1.
  11. If AA has linearly independent columns, what is the matrix of orthogonal projection onto Col A\text{Col}\,A?
    A(ATA)−1ATA(A^TA)^{-1}A^T. Independence of the columns makes ATAA^TA invertible.
  12. What is the component of (3,1)(3, 1) orthogonal to (1,2)(1, 2)?
    (2,−1)(2, -1). The projection is 55(1,2)=(1,2)\frac{5}{5}(1, 2) = (1, 2), and (3,1)−(1,2)=(2,−1)(3, 1) - (1, 2) = (2, -1).

Study these flashcards