Principal Directions & Quadratic Forms - Linear Algebra
- For the quadratic form , suppose we want to eliminate all cross-product terms by rotating to principal axes. If the coefficient matrix has eigenvalues , , and , what type of quadric surface does the equation represent? Answer: A hyperboloid of one sheet because the quadratic form has one negative and two positive eigenvalues When you encounter a quadratic form and need to classify the resulting quadric surface, the key insight is that the eigenvalues of the coefficient matrix determine the surface type after rotation to principal axes. First, let's extract the coefficient matrix from . The symmetric matrix is: After diagonalization using the given eigenvalues , , , the equation becomes in principal coordinates, or equivalently . This canonical form has two positive terms and one negative term, which defines a hyperboloid of one sheet. The correct answer is D. Here's why the other options fail: A is wrong because not all eigenvalues are positive (). B incorrectly identifies the surface type—while the trace does equal the sum of eigenvalues, this gives us a hyperboloid, not a paraboloid. C confuses hyperboloid types: having one negative eigenvalue with a positive constant gives a hyperboloid of one sheet, not two sheets. Study tip: For quadric surface classification, count the signs of the eigenvalues in the canonical form. Two positive, one negative = hyperboloid of one sheet. Two negative, one positive = hyperboloid of two sheets. All same sign = ellipsoid.
- A quadratic form is defined by a symmetric matrix with eigenvalues and . The corresponding orthonormal eigenvectors are and . After an orthogonal change of variables , where , what is the resulting quadratic form ? Answer: The Principal Axes Theorem states that an orthogonal change of variables , where the columns of are orthonormal eigenvectors of , transforms the quadratic form into , where is a diagonal matrix with the eigenvalues of on the diagonal. The new quadratic form has no cross-product terms and is given by . In this case, with and , the new form is . The eigenvector information is used to define the transformation but does not appear as coefficients in the new form.
- Consider two quadratic forms and where and are symmetric matrices. If and have the same eigenvalues but different eigenvectors, which statement about their principal directions is necessarily true? Answer: The principal directions of and are related by some orthogonal transformation When you encounter questions about quadratic forms and their geometric properties, focus on the relationship between eigenvalues, eigenvectors, and the geometric transformations they represent. The key insight here is understanding what "same eigenvalues but different eigenvectors" means geometrically. Since both matrices are symmetric with identical eigenvalues, they represent ellipses (or other conic sections) with the same "shape" - the same ratio of axes lengths. However, these ellipses are oriented differently in space because their eigenvectors (principal directions) differ. The correct answer is C because matrices with the same eigenvalues are related by a similarity transformation. Specifically, if and have the same eigenvalues, then for some orthogonal matrix . This orthogonal transformation rotates the principal directions of to those of while preserving the eigenvalues. Let's examine why the other options fail: A is incorrect because the angle between principal directions depends on the orthogonal transformation relating the matrices, not on eigenvalue differences. B makes a fundamental error - eigenvalues definitely do not determine eigenvectors uniquely, especially when eigenvalues have multiplicity greater than one. D is wrong because the relative orientation is precisely determined by the orthogonal transformation; it's not arbitrary. Remember this principle: for symmetric matrices, having the same eigenvalues means the quadratic forms have the same "intrinsic shape" but potentially different orientations, connected by a rotation. This geometric perspective helps clarify the relationship between algebraic properties and spatial transformations.
- The quadratic form is diagonalized by an orthogonal change of variables , resulting in a new quadratic form with no cross-product term. Which of the following matrices could be ? Answer: The matrix of the quadratic form is . The columns of the change-of-variable matrix must be a set of orthonormal eigenvectors of . The eigenvalues of are given by , which yields and . The corresponding eigenvectors are proportional to and , respectively. To form the orthogonal matrix , these eigenvectors must be normalized to have a length of 1. The normalized vectors are and . Placing these as columns gives the matrix in choice B. Choice D is also a valid matrix (the order and sign of eigenvectors can vary), but standard construction often pairs the eigenvectors in the given order. Let's assume the question asks for one possibility. Both B and D are technically correct, but B corresponds to the eigenvalue order 6 then -2. Let's stick with B. A contains non-normalized eigenvectors. C is the matrix itself. D is also a valid matrix, but B is the most standard construction matching the order of eigenvalues found.
- Consider the quadratic form . If the principal directions are determined by the eigenvectors of the associated matrix, which of the following statements about the transformation that diagonalizes this quadratic form is correct? Answer: The principal directions are orthogonal and the transformed quadratic form is positive definite with eigenvalues and The matrix associated with the quadratic form is . Since is symmetric, its eigenvectors are orthogonal and form the principal directions. The characteristic polynomial is . Both eigenvalues are positive (2 and 7), making the quadratic form positive definite. Choice A is wrong because both eigenvalues are positive. Choice C is incorrect because the matrix is symmetric. Choice D confuses eigenvectors with fundamental subspaces.
- Consider the quadratic form . What is the maximum value of for all points on the unit circle ? Answer: 4 The maximum value of a quadratic form subject to the constraint is the largest eigenvalue of the matrix . The matrix for this quadratic form is . The characteristic equation is , which means . The eigenvalues are , so and . The largest eigenvalue is 4, which is the maximum value of on the unit circle.
- Let be a symmetric matrix representing the quadratic form . The eigenvalues of are $5, 2,$ and . Which statement best describes the geometry of the set of points in where ? Answer: A cone When you encounter quadratic forms and their zero sets, you're dealing with conic sections in higher dimensions. The key insight is that the eigenvalues of the symmetric matrix determine the geometric shape through the signs and multiplicities of these values. For the quadratic form , we can diagonalize the symmetric matrix using its eigenvalues. In the principal axis coordinate system, this becomes , or equivalently . This equation describes a cone because we have two positive eigenvalues and one negative eigenvalue. The positive terms are balanced by the negative term, creating the characteristic double-cone structure where the surface extends infinitely in both directions along the axis corresponding to the negative eigenvalue. Choice A is correct - this mixed signature (two positive, one negative eigenvalue) always produces a cone. Choice B (hyperboloid of one sheet) would require the equation where , not . Choice C (ellipsoid) would need all eigenvalues to have the same sign, which isn't the case here. Choice D (only the origin) would occur if all eigenvalues were positive or all were negative, making the quadratic form definite. Remember this pattern: for , count the positive and negative eigenvalues. Mixed signs with zero eigenvalues give cylinders, mixed signs without zero eigenvalues give cones, and same signs give only the trivial solution.
- Let be a quadratic form where is a symmetric matrix. If the level sets for any non-zero constant are hyperbolas, which of the following must be true about matrix ? Answer: The determinant of is negative. The level sets of a quadratic form are hyperbolas if and only if the form is indefinite. A quadratic form is indefinite if its associated symmetric matrix has both positive and negative eigenvalues. The determinant of a matrix is the product of its eigenvalues. If one eigenvalue is positive and the other is negative, their product must be negative.
- A quadratic form in has the property that its associated matrix has eigenvalues with corresponding eigenvectors . If we consider the ellipsoid , which statement correctly describes the relationship between the principal axes of this ellipsoid and the eigenstructure of ? Answer: The longest semi-axis of the ellipsoid is in the direction of with length When you encounter quadratic forms and ellipsoids, the key insight is understanding how eigenvalues and eigenvectors of the matrix translate to the geometric properties of the resulting ellipsoid. The equation defines an ellipsoid whose principal axes align with the eigenvectors of . To find the semi-axis lengths, consider what happens when you move along an eigenvector direction. If where is a unit eigenvector, then . Solving for gives , which is the semi-axis length in the direction. Since , we have . Therefore, the longest semi-axis corresponds to the smallest eigenvalue , making answer D correct. Answer A incorrectly associates the longest axis with the largest eigenvalue. The relationship is actually inverse—larger eigenvalues produce shorter semi-axes. Answer B is vague and incorrect; the determinant doesn't directly determine axis lengths. Answer C has the eigenvalue-to-length relationship backwards; it should be , not . Study tip: Remember the inverse relationship in quadratic forms: for ellipsoids defined by , larger eigenvalues create stronger "compression" in those directions, resulting in shorter axes. The smallest eigenvalue always corresponds to the longest axis.
- Consider the quadratic form . The level set defines an ellipse in the -plane. What is the direction of the major axis of this ellipse? Answer: The direction is parallel to the vector . The symmetric matrix associated with is . The principal axes of the ellipse are along the eigenvectors of . The characteristic equation is , which gives eigenvalues and . The equation of the ellipse in the principal axis coordinate system is . This can be written as . The semi-major axis has length , which corresponds to the smaller eigenvalue . We find the eigenvector for : , which gives an eigenvector proportional to . This is the direction of the major axis.
- A quadratic form in has eigenvalues , , and with corresponding orthonormal eigenvectors . After rotating to principal axes, what is the canonical form of the quadratic surface ? Answer: , representing a hyperboloid of one sheet In the principal coordinate system aligned with the eigenvectors, the quadratic form becomes . Since we have eigenvalues with mixed signs (two positive, one negative), this represents a hyperboloid of one sheet, not two sheets. Choice B incorrectly divides the equation by 12. Choice C has the correct equation but wrong surface type (hyperboloid of two sheets would require two negative eigenvalues). Choice D incorrectly assumes all eigenvalues are positive.
- For which values of the constant is the quadratic form positive definite? Answer: A quadratic form is positive definite if and only if all eigenvalues of its associated symmetric matrix are positive. The matrix is . For a matrix, the eigenvalues are both positive if and only if the determinant is positive and the trace is positive. Condition 1: , which implies . Condition 2: , which implies . Both conditions must hold. The first condition, , is stricter and automatically implies the second condition. Thus, the quadratic form is positive definite if and only if .
- An orthogonal transformation converts a quadratic form into the diagonal form . The principal direction corresponding to the -axis is parallel to the vector . What is the matrix ? Answer: The eigenvalues of are and . The eigenvector for is parallel to . Its normalized form is . The eigenvector for must be orthogonal to , so it is parallel to . Its normalized form is . We reconstruct using spectral decomposition . With and , we compute: . Choice A results from incorrectly associating with the given eigenvector. Choice B has a sign error in the off-diagonal. Choice D is the correctly simplified matrix.
- Let be a symmetric matrix with three distinct eigenvalues. The level surface is an ellipsoid. Which of the following statements about the principal axes of this ellipsoid is always true? Answer: The principal axes are mutually orthogonal to each other. The Principal Axes Theorem states that the principal axes of the level surface are in the directions of the eigenvectors of the matrix . For a symmetric matrix, eigenvectors corresponding to distinct eigenvalues are always orthogonal. Since the three eigenvalues are distinct, the three corresponding eigenvectors (which define the principal axes) must be mutually orthogonal.
- A symmetric matrix has eigenvalues and . Let . Which of the following statements about is FALSE? Answer: The maximum value of on the unit circle is . The maximum value of on the unit circle is the largest eigenvalue of . The eigenvalues are and . The larger of these two values is . Therefore, the statement that the maximum value is is false. Let's verify the other statements: (A) Since both eigenvalues are negative, the quadratic form is negative definite, meaning for all . This is true. (B) For a negative definite form, level sets for are ellipses. This is true. (C) The determinant of is the product of its eigenvalues, , so is invertible. This is true.
- Consider the quadratic form where is a symmetric matrix with eigenvalues . If are the corresponding orthonormal eigenvectors, and we define a new coordinate system using these principal directions, which statement about the level surfaces for is correct? Answer: The level surfaces are hyperboloids of one sheet with the direction as the axis of the hyperboloid With eigenvalues , the canonical form is where correspond to directions . Since we have two positive and one negative eigenvalue, for , the level surfaces are hyperboloids of one sheet. The negative term corresponds to the direction, which becomes the axis along which the hyperboloid extends. Choice A is wrong because the matrix has a negative eigenvalue. Choice C confuses hyperboloids of one sheet (2 positive, 1 negative eigenvalue) with two sheets (1 positive, 2 negative). Choice D is incorrect because level surfaces are bounded.
- Consider the constrained optimization problem: maximize subject to . Using the relationship between quadratic forms and their principal directions, what is the maximum value of on the unit circle? Answer: The maximum value is , achieved along the principal direction corresponding to the larger eigenvalue When you encounter a quadratic form optimization problem on a constraint, you're dealing with finding eigenvalues of a matrix. The key insight is that the maximum and minimum values of a quadratic form on the unit circle are precisely the largest and smallest eigenvalues of its coefficient matrix. First, extract the coefficient matrix from . Since the cross-term contributes to both off-diagonal entries, the matrix is . To find eigenvalues, solve : Using the quadratic formula: The maximum value occurs at the larger eigenvalue: , confirming answer C. Answer A gives the smaller eigenvalue, which would be the minimum value, not maximum. Answer B incorrectly suggests the maximum is - while the gradient condition is relevant for Lagrange multipliers, this specific value doesn't arise from our eigenvalue calculation. Answer D claims the maximum is (half the trace), but the trace only gives the sum of eigenvalues, not individual extrema. Remember: for quadratic form optimization on the unit circle, always find the eigenvalues of the coefficient matrix - the largest eigenvalue is your maximum value.
- The quadratic form represents a degenerate conic. After diagonalization, what can be concluded about the principal directions and the geometric nature of the level curves ? Answer: The matrix has eigenvalues and , so the level curves are parallel lines for The matrix is . The characteristic polynomial is . So eigenvalues are and . Since one eigenvalue is zero, the quadratic form is degenerate (determinant of is zero). The level curves for are indeed parallel lines because the form can be written as in principal coordinates, where corresponds to the zero eigenvalue. Choice B is wrong because these are lines, not parabolas. Choice C is incorrect about repeated eigenvalues. Choice D has wrong eigenvalues.