Orthogonality & Complements - Linear Algebra
- The set of vectors is given to be an orthogonal set. What must be the value of ? Answer: For a set of vectors to be orthogonal, every pair of distinct vectors in the set must have a dot product of zero. Let the vectors be . We must have and . Let's use the first condition: . . Setting the dot product to zero: , which gives , so . We can verify this with the second condition: . If , then . Both conditions are satisfied.
- Let and let be the subspace of spanned by . The vector can be written as , where and . What is the vector ? Answer: The vector is the orthogonal projection of onto the line spanned by . The formula is . First, calculate the dot products: . . Now find : . The vector is the component of orthogonal to , which is found by . . Choice A is , the projection onto , a common error.
- Let be the subspace of spanned by the vectors and . Which of the following vectors is in ? Answer: A vector is in if and only if it is orthogonal to every vector in a spanning set for . Therefore, we need to find a vector such that and . Let's test choice A: . . . Since the vector in choice A is orthogonal to both spanning vectors, it is in . Choice B is orthogonal to but not . Choice C is in itself (it's ). Choice D is orthogonal to but not .
- Let be a set of non-zero vectors in . If is an orthogonal set, which of the following statements must be true? Answer: is a linearly independent set. When you encounter questions about orthogonal sets, focus on what orthogonality guarantees versus what it doesn't. An orthogonal set means every pair of distinct vectors has a dot product of zero: for all . The key insight is that orthogonal sets of non-zero vectors are automatically linearly independent. Here's why: suppose we have a linear combination . Taking the dot product of both sides with gives us . Since the vectors are orthogonal, all terms except the first vanish, leaving . Since is non-zero, we must have . Repeating this argument for each vector shows all coefficients are zero, proving linear independence. Therefore, D is correct. A is wrong because we need exactly linearly independent vectors to form a basis for , but could be less than . B is incorrect—there's no reason why every vector in must be orthogonal to some vector in . C fails for the same reason as A: if , the span of is only a -dimensional subspace, not all of . Remember: orthogonality always implies linear independence for non-zero vectors, but it doesn't guarantee the set spans the entire space or forms a basis.
- Consider the inner product space of continuous functions on with inner product . Let . Which function is in ? Answer: (the constant function) When you encounter orthogonal complement problems in function spaces, you need to find which functions are perpendicular to every function in the given subspace . The key insight is understanding what it means for two functions to be orthogonal under the given inner product. The subspace contains all continuous functions whose integral over equals zero. For a function to be in , it must satisfy for every . This means whenever . The constant function is in because for any : by the definition of . This makes choice D correct. Let's check why the others fail. For choice A, : we can verify , so this function is actually in , not in . Similarly, choice C gives , placing it in . Choice B also integrates to zero: , wait—this actually gives , but it's still not in since it doesn't satisfy the orthogonality condition with all functions in . Remember: consists of functions orthogonal to the entire subspace , which often includes the "simplest" functions that naturally pair to zero with the constraint defining .
- Let be a subspace of an inner product space , and let . The orthogonal projection of onto is denoted . Which statement about is always true? Answer: and minimizes over all By definition of orthogonal projection, , and is the unique vector in closest to . This means for all . Choice A incorrectly places the difference vector in . Choice B incorrectly describes it as closest among vectors in . Choice D incorrectly equates it with .
- Let be a matrix with . What is the dimension of the orthogonal complement of the row space of ? Answer: 3 The orthogonal complement of the row space of , , is the null space of , . The question asks for the dimension of . According to the Rank-Nullity Theorem, for a matrix with columns, . In this case, has columns and its rank is given as 3. Therefore, , which implies .
- Let be a finite-dimensional inner product space and a subspace of . If and , and can be written as where and , what is ? Answer: By the fundamental theorem about orthogonal complements in finite-dimensional inner product spaces, . Given and , we have . Choice A incorrectly assumes . Choice D would mean , which only occurs when . Choice C results from the incorrect calculation .
- Let be the subspace of consisting of all vectors that satisfy the equations and . Which of the following vectors lies in ? Answer: The subspace is the set of solutions to a homogeneous system of linear equations, which means is the null space of the matrix . The orthogonal complement of the null space of a matrix is its row space, i.e., . Therefore, we are looking for a vector that is a linear combination of the rows of . The rows are and . Let's check the options: - Choice A: is in because and . It cannot be in unless it is the zero vector. - Choice B: is the sum of the two rows: . Since it is a linear combination of the rows, it is in the row space, and thus in . - Choices C and D are not linear combinations of the rows of .
- Let be a linear transformation with matrix representation . How are and related? Answer: and where Row When analyzing relationships between subspaces associated with a linear transformation, you need to understand where each subspace lives and apply the Fundamental Theorem of Linear Algebra, which reveals four interconnected subspaces. For the linear transformation with matrix , the kernel consists of all vectors such that . The Fundamental Theorem tells us that is the orthogonal complement of the row space of . Since the rows of are vectors in , we have and in . This makes answer D correct. A is wrong because it confuses the column space relationship. The kernel and column space orthogonal complement aren't equal. B is incorrect because there is a fundamental relationship between these subspaces, just not the one initially suggested. C contains two errors: exists in (the domain), not , and the kernel isn't the orthogonal complement of the column space. Key strategy: Remember the four fundamental subspaces come in orthogonal pairs within the same vector space: in , and in . Always check which space each subspace lives in before claiming relationships.
- Let be the subspace of spanned by the vector . Which of the following sets is a basis for the orthogonal complement ? Answer: The orthogonal complement consists of all vectors such that . This gives the equation . This is the equation of a plane in . Since and , the dimension of must be . Therefore, a basis for must contain two linearly independent vectors. Both vectors in choice B satisfy the equation: and . They are also linearly independent. Thus, they form a basis for .
- Let and be subspaces of . Which of the following expressions is always equivalent to ? Answer: When you encounter questions about orthogonal complements and subspace operations, the key is understanding how these operations interact with each other. This requires familiarity with fundamental properties of orthogonal complements. To find , we need to apply the crucial property that for any subspaces and : . Applying this property with and : Since taking the orthogonal complement twice returns you to the original subspace (i.e., for any subspace ), we have: and Therefore: Now for the incorrect options: A confuses the relationship— would actually equal , not our expression. B represents set union, which isn't even a subspace operation (the union of subspaces is generally not a subspace). C gives us , which equals —essentially the "opposite" of what we want. Strategy tip: Memorize the key duality: and . These relationships flip sums to intersections and vice versa when taking orthogonal complements.
- In the inner product space of continuous functions on the interval with the inner product , let and . For what value of are and orthogonal? Answer: For and to be orthogonal, their inner product must be zero. We set up the integral: We evaluate the integral: Setting the result to zero gives , which solves to , so .
- Let be a subspace of . Which of the following statements is NOT always true? Answer: . The union of two subspaces is not generally a subspace, and it does not typically equal the entire vector space. For example, in , if is a line through the origin (a 1D subspace), then is a plane through the origin (a 2D subspace). The union consists of only the points on that line and on that plane, which does not include all points in . The other three statements are fundamental properties of orthogonal complements in .
- Let be the subspace of spanned by the vectors and . If , which of the following systems of equations must satisfy? Answer: and For to be in , it must be orthogonal to every vector in . Since , we need and . Computing: and . Choice A has the wrong sign for in the second equation. Choice C omits the term entirely. Choice D incorrectly includes in the second equation.
- Consider the subspace of with the standard inner product. Which of the following vectors spans ? Answer: The subspace is defined by the system of linear equations. The orthogonal complement is spanned by the normal vectors to these hyperplanes. From , we get normal vector . From , we get normal vector . Choice B has the wrong sign in the second vector. Choice C has the wrong signs in the first vector. Choice D has wrong signs in both vectors' components.
- In with the standard inner product, let be a set of vectors. If , which statement must be true? Answer: The vectors in span but may be linearly dependent If , then span has no non-zero orthogonal vectors, which means span (since and ). However, the vectors in need not be linearly independent; we could have redundant vectors. Choice A incorrectly requires orthonormality and specific cardinality. Choice B incorrectly requires linear independence. Choice D contradicts the given condition since if span, then .
- Let and be subspaces of a finite-dimensional inner product space . If (meaning every vector in is orthogonal to every vector in ), which relationship between and is correct? Answer: regardless of the orthogonality condition The identity is a fundamental property of orthogonal complements that holds for any subspaces and , regardless of whether . A vector is orthogonal to if and only if it's orthogonal to both and . Choice B incorrectly suggests the equality depends on orthogonality. Choice C provides an incorrect dimension formula. Choice D incorrectly suggests only inclusion holds generally, when equality always holds.
- In , let be the plane defined by the equation . Which of the following provides a geometric description of the orthogonal complement ? Answer: The line passing through the origin with direction vector . The equation of the plane can be written as a dot product: . This shows that every vector in the plane is orthogonal to the normal vector . The orthogonal complement is the set of all vectors that are orthogonal to every vector in . This set is precisely the line spanned by the normal vector . Therefore, is the line through the origin with direction vector .
- Let be the column space of the matrix . Which of the following vectors forms a basis for the orthogonal complement ? Answer: The orthogonal complement of the column space of , denoted , is the null space of , i.e., . First, we find the transpose of : . To find the null space, we solve . This corresponds to the system of equations and . From these equations, we get and . A vector in the null space has the form . Thus, a basis for is .