Loading…
Loading…
Define eigenvalues through the equation Av=λv, then recast the same idea as a null-space and determinant question so the structure becomes computable.
Let be positive integers, let , , and . All the following arguments use the row-by-column definition and finite real sums. For any output position ,
The middle equality only reorders two finite sums and uses real distributivity. Both products are , so equality at every position proves associativity. No factor has changed its order.
For , the same definition gives
For , it gives
Thus both distributive laws hold with the displayed matching sizes. For every real scalar ,
proving by entrywise equality. In particular, for and real ,
This proves the matrix-vector linearity used when comparing solutions of the same linear system. All identities concern compatible finite real matrices; they do not assert commutativity or cancellation of arbitrary matrix factors.
Let be any field, and use formal polynomials in . The zero polynomial is a separate case whenever degree is used. For nonzero , the leading coefficient of is the product of their nonzero leading coefficients, so ; in particular there are no zero divisors.
For every and every nonzero there are unique polynomials with , where or . Start with residual and quotient zero. If a nonzero residual has degree , subtract , where are its and 's leading coefficients, and add to the quotient. The new residual is zero or has strictly smaller degree. Nonnegative integer degrees cannot strictly decrease indefinitely, so the process stops. If two answers exist, ; a nonzero left side has degree at least , whereas a nonzero right side has degree below . Thus both differences are zero.
For , the finite identity
gives . Consequently exactly when divides . This does not assert that any root exists in .
Let be a commutative ring with identity, , and . Define
The sign is , interpreted in . Exchanging adjacent entries in a permutation changes its inversion count by one in parity. Sorting by adjacent inversions therefore gives its sign as the product of the signs of those exchanges. Applying an adjacent-exchange decomposition of to the positions of proves ; a transposition has sign . These are integer parity facts before mapping the signs into .
The finite formula is multilinear in each row and column. If two rows are equal, pair each permutation term with the term obtained by exchanging the two assigned columns. The pair is distinct, has the same product and opposite signs; its sum is zero in every characteristic. Thus the determinant vanishes on repeated rows; the column statement is identical. This is a paired cancellation, not an inference from . Exchanging rows or columns changes sign by the same permutation substitution. Also . Substituting in the sum gives .
Here is the needed uniqueness principle, valid even with zero divisors. If is an alternating multilinear function of column vectors in , expand each input in the standard basis. Terms with a repeated basis vector vanish. The other index lists are permutations; swapping two slots negates , since expansion of gives . Hence the expansion equals times the Leibniz determinant of the input columns. No division or field assumption was used.
For fixed , the function is alternating multilinear, with . Applying the preceding uniqueness principle to the columns of proves
For with square block sizes , a nonzero Leibniz term must assign all last rows to the last columns; otherwise one lower-left entry is zero. Those rows use all those columns, so the first rows use the first columns. The remaining permutations are exactly pairs of permutations inside the two blocks, with product sign and product monomial. Summing gives , including an empty block using determinant one. This argument also covers terms that vanish for other reasons; it does not require absence of zero divisors.
Let delete row and column , and put . Grouping the Leibniz sum by the value gives row cofactor expansion . The sign factor follows by moving row and column to the first positions, making adjacent exchanges; the remaining permutation is on the undeleted indices. Transpose gives the column expansion. Define . The entry of is , the cofactor expansion of the matrix obtained by replacing row by row . It is if , and zero otherwise by repeated-row cancellation. The column argument gives the other product. Therefore
For , the empty minor has determinant one, so the adjugate is and the identity still holds. For , define the adjugate to be the empty matrix; the identity is the equality of the unique empty matrices, while the determinant remains one. All results in this section apply to ; no division by a determinant has occurred.
A vector space is a set with addition and scalar multiplication satisfying the usual abelian-group and distributive axioms over a field . Columns are one model. Polynomials of degree at most , denoted , and linear maps between spaces are others. The zero polynomial is included in although its degree is not ordinarily defined.
A subspace contains zero and is closed under sums and scalar multiples. A list spans if every vector is a linear combination of its entries; it is independent if only the zero coefficients give zero. A basis is both. A finite spanning list can be reduced to a basis by deleting dependent entries; an independent list can be extended to a basis by adding vectors outside its span until the given finite spanning list is spanned.
Exchange lemma. An independent list of vectors in the span of vectors has . To see this, express the first independent vector in the spanning list, use a nonzero coefficient to replace one spanning vector by it, and repeat. At each stage independence ensures the next independent vector has a nonzero coefficient on an as-yet unreplaced spanning vector. There must be at least such slots. Comparing two bases in both directions proves that their lengths agree; this common length is .
Consequently, in dimension , any independent vectors form a basis, as do any spanning vectors. Counting a list is useful only after its independence or spanning has been justified.
A map is linear if . Its kernel and image are subspaces. Choose a basis of and extend to a basis with . Then form a basis of : spanning follows by expanding any input; a dependence among these images places the corresponding input combination in the kernel, and independence of the extended basis makes all coefficients zero. Thus
This is rank–nullity. In equal finite dimensions, injectivity and surjectivity are equivalent, but the equivalence can fail in infinite-dimensional spaces.
Now let be a field. If , the adjugate identity gives inverse . If is invertible, multiplicativity gives , so . Rank–nullity, proved in C01, shows a finite square linear map has zero kernel exactly when it is invertible. Thus exactly when its kernel is nonzero.
For a fixed , apply the ring construction to . Its determinant is monic of degree : the identity-permutation product contributes , whereas every other permutation uses an off-diagonal constant entry, so its product is either zero or has degree less than . Multiplicativity proves invariance under with invertible constant ; the block-triangular formula proves restriction–quotient factorization. Finally every adjugate entry is zero or has degree at most , so their coefficient comparison is legitimate in the C02 Cayley–Hamilton proof. In dimension zero, the characteristic polynomial is the empty determinant one; evaluating it gives on the zero space, which is its zero operator, so Cayley–Hamilton is separate and immediate. This supplies the actual commutative-ring determinant prerequisites without extending any real-only determinant authority.
Determinants tell you whether a square matrix is invertible. Eigenvalues ask a different question: which nonzero vectors keep their line when the matrix acts on them? If , then the line is mapped into itself. When , the orientation along that line is preserved; when , it is reversed; and when , the vector is sent to the zero vector, which has no direction. The line-invariance statement remains meaningful in all three cases.
A general matrix need not preserve every line. A scalar multiple of the identity maps every line into itself, including the zero-scalar case: maps every vector to zero. For a fixed scalar , the nonzero eigenvectors become an eigenspace when is adjoined; across different eigenvalues, the collection of all eigenvectors need not be a subspace. An eigenvector is useful because the matrix action on it is completely described by one scalar. That scalar records stretching, shrinking, reversal, or collapse.
When you solve , you focus on one right-hand side and the whole system. When you study eigenvalues, you focus on the special vectors for which
This equation later lets us simplify powers of matrices, recognize diagonal matrices in a suitable basis, and describe invariant directions. The practical route is to turn it into a homogeneous system and then use the null-space, rank, and determinant tools already developed.
For a first picture, take . The horizontal vector becomes and the vertical vector becomes : each stays on its own line. But becomes , which is on a different line through the origin. Thus finding eigenvectors means identifying the exceptional directions where a matrix acts by a single scale factor.
Definition
Let be a real matrix with . Let and let be nonzero. We say that is an eigenvector of with eigenvalue if
The condition is essential. The zero vector satisfies for every scalar, so allowing it would make every scalar look like an eigenvalue. The eigenspace introduced below will contain , but the word eigenvector always refers to a nonzero vector.
The equation is equivalent to . For a fixed eigenvalue , the nonzero solutions are eigenvectors; including zero gives the eigenspace.
Theorem
Let be a square matrix and let . If
then .
Subtracting the two equations gives . Choose a coordinate . Its th coordinate says . Since is a nonzero real number, cancellation gives , hence . The nonzero hypothesis is exactly what makes this cancellation valid.
Theorem
If is an eigenvector of with eigenvalue , then every nonzero scalar multiple is also an eigenvector of with eigenvalue .
Indeed, for ,
The vector is still nonzero, so it satisfies both parts of the definition. Thus all nonzero points on the line through one eigenvector are eigenvectors, rather than just one isolated point.
Theorem
Suppose are eigenvectors of , all with the same eigenvalue . Every nonzero linear combination
is also an eigenvector of with eigenvalue .
Let . Linearity gives
If , this is an eigenvector. The coefficients need not all be zero, but their combination can still cancel to ; that zero output belongs to the eigenspace but is not an eigenvector. This is why “nonzero combination” is part of the theorem. Components can cancel even when several coefficients are nonzero.
Definition
For an matrix and scalar , define
When is an eigenvalue, this space contains all its eigenvectors and also the zero vector. If is not an eigenvalue, the same null-space notation gives .
Worked example
Let
For
Thus has eigenvalue . For ,
so has eigenvalue . The same matrix can therefore preserve two different lines, with different scaling factors.
The common-eigenvalue combination theorem does not apply to , because their eigenvalues differ. In fact,
If this sum were an eigenvector, the second coordinate would force , while the first would require , a contradiction.
Worked example
Let
For , write . Then
For , the equation reduces in every coordinate to . Therefore
The two displayed vectors are linearly independent: if , then the second coordinate gives and the third gives . They form a basis for the two-dimensional eigenspace.
For , the equations say , so . Hence
This example separates two ideas. One fixed nonzero vector cannot have two eigenvalues, but one eigenvalue can have a whole plane of eigenvectors. The plane includes as a vector in the eigenspace; its nonzero points are the eigenvectors.
Move all terms in to one side:
The identity matrix is needed because . This rewrite makes the eigenvalue problem a homogeneous-system problem.
Theorem
Let be an matrix, let be a scalar, and let . Then the following are equivalent:
The forward direction is just rearrangement of . Conversely, a nontrivial solution is nonzero and rearranges to , so it meets the definition.
The null-space description gives closure directly. If and are scalars, then
Thus is a subspace. It has positive dimension exactly when is an eigenvalue; otherwise its dimension is zero.
The number is called the geometric multiplicity of . It counts independent eigenvector directions for that eigenvalue: in the matrix above, the eigenvalue has geometric multiplicity , whereas has geometric multiplicity . This dimension is obtained by solving the null-space equations, after the candidate scalar has been found.
Concept lensStructural
For a fixed eigenvalue , the solutions of form a null space. This solution set already contains zero and is closed under addition and scalar multiplication; the eigenvectors are precisely its nonzero members. The union of eigenspaces for different eigenvalues need not be closed under addition. In the first example, is an explicit non-eigenvector sum. Keep each fixed- eigenspace separate from the collection of all eigenvectors.
Theorem
Let be an matrix and let be a scalar. The following statements are equivalent:
The implications are the familiar homogeneous-system dictionary. A nontrivial solution is exactly a nonzero null-space vector, so (1), (2), and (3) are the same condition. A square matrix has a nontrivial null space exactly when it is not invertible, giving (3) (4). The determinant criterion then gives (4) (5). In particular, an eigenvalue forces . The determinant equation is a way to discover candidate eigenvalues; the null space is still required to find the corresponding eigenvectors.
Once a candidate is known, form and row reduce it. The free variables in the resulting homogeneous system parameterize every vector in . The number of free variables is the dimension of that eigenspace, so it tells you how many independent eigenvector directions are available. Every nonzero vector in the resulting span is an eigenvector, while the zero vector remains part of the space only because a subspace must contain zero. This is why an eigenvalue list is incomplete without its eigenspaces. For a repeated eigenvalue, the determinant records algebraic multiplicity, whereas the null-space calculation records geometric multiplicity; comparing them is a key question for the diagonalization developed in the next section.
Worked example
Let
First find the eigenvalues from
Factoring gives and . For ,
so and
For ,
so and
The determinant calculation discovers the two scalars. Each row reduction then solves a different homogeneous system; substituting the basis vectors verifies and .
For a diagonal matrix , the eigenvector equation is especially transparent:
Thus
where the span is if no diagonal entry equals . Repeated diagonal entries therefore increase the dimension of an eigenspace. For the zero matrix every nonzero vector is an eigenvector with eigenvalue ; for the identity matrix every nonzero vector is an eigenvector with eigenvalue .
If is upper or lower triangular, then is triangular, so
The eigenvalues are exactly the diagonal entries, counted with their algebraic multiplicity. The diagonal entries do not by themselves determine the eigenvectors. For the upper triangular matrix
, so spans . For , gives , hence
Changing the upper-right entry would keep the diagonal and eigenvalues while changing this eigenspace. The diagonal data alone are therefore insufficient.
Theorem
For a square matrix , the following are equivalent:
Equivalently, is invertible if and only if is not an eigenvalue.
This is the equivalent-tests theorem with .
For completeness, if is an eigenvalue then some nonzero satisfies , so the null space is nontrivial and cannot be invertible. Conversely, if is not invertible, the square-matrix dictionary supplies a nonzero vector in ; it satisfies , so is an eigenvalue. The two directions use the same homogeneous-system criterion.
Theorem
If is an eigenvalue of , then:
For (1), if then ; this also covers , because the zero matrix has every nonzero vector as a -eigenvector. For powers with , induction gives : the induction step multiplies by and uses . The case is separate: , and the same nonzero has eigenvalue for . We do not interpret this as the expression .
For (4), invertibility implies . Multiplying by gives , so division by gives . For (3), use the determinant identity
This proves the transpose statement through the eigenvalue criterion. It is not valid to transpose and conclude that . For the matrix , but
The core definition above is over . Consider the real matrix
For a real scalar ,
Therefore has no real eigenvalues or real eigenvectors. Over , the same matrix has eigenvalues and . With
we verify
Solving the first row of gives , while the first row for gives . Hence over the eigenspaces are and . This example marks the field boundary: nonreal roots are not real eigenvalues, but they become valid after the scalar field is explicitly changed.
Common mistake
The equation holds for every scalar, but the definition excludes . An eigenspace is a subspace and therefore contains ; its nonzero members are the eigenvectors. Also remember that an eigenvalue belongs to a specified matrix and scalar field.
Checkpoint
Assume .
Yes. , and .
Checkpoint
Use and the homogeneous-system criterion.
If is an eigenvalue, then has a nontrivial solution. The null space of is nontrivial, so is not invertible.
Checkpoint
Use the definition above.
It is the null space of , including the zero vector.
Checkpoint
Multiply first, then compare the output with the original vector.
The vector is an eigenvector with eigenvalue .
Checkpoint
Solve .
Thus is free and
Checkpoint
Use the transpose property and the invertibility criterion together.
No. Invertibility of implies invertibility of . By the zero-eigenvalue criterion, cannot have as an eigenvalue.
Keep 7.2 Row operations, products, and invertibility nearby, because the test depends directly on determinant and invertibility reasoning.
Continue with 8.2 Diagonalization and similarity to see how a full basis of eigenvectors changes the shape of a matrix.
The subspace viewpoint here also leans on 6.5 Basis and dimension.