Loading…
Loading…
Treat diagonalization as a basis change built from eigenvectors, then use similarity to explain when a matrix can be simplified without changing its essential eigenvalue data.
Let be positive integers, let , , and . All the following arguments use the row-by-column definition and finite real sums. For any output position ,
The middle equality only reorders two finite sums and uses real distributivity. Both products are , so equality at every position proves associativity. No factor has changed its order.
For , the same definition gives
For , it gives
Thus both distributive laws hold with the displayed matching sizes. For every real scalar ,
proving by entrywise equality. In particular, for and real ,
This proves the matrix-vector linearity used when comparing solutions of the same linear system. All identities concern compatible finite real matrices; they do not assert commutativity or cancellation of arbitrary matrix factors.
A vector space is a set with addition and scalar multiplication satisfying the usual abelian-group and distributive axioms over a field . Columns are one model. Polynomials of degree at most , denoted , and linear maps between spaces are others. The zero polynomial is included in although its degree is not ordinarily defined.
A subspace contains zero and is closed under sums and scalar multiples. A list spans if every vector is a linear combination of its entries; it is independent if only the zero coefficients give zero. A basis is both. A finite spanning list can be reduced to a basis by deleting dependent entries; an independent list can be extended to a basis by adding vectors outside its span until the given finite spanning list is spanned.
Exchange lemma. An independent list of vectors in the span of vectors has . To see this, express the first independent vector in the spanning list, use a nonzero coefficient to replace one spanning vector by it, and repeat. At each stage independence ensures the next independent vector has a nonzero coefficient on an as-yet unreplaced spanning vector. There must be at least such slots. Comparing two bases in both directions proves that their lengths agree; this common length is .
Consequently, in dimension , any independent vectors form a basis, as do any spanning vectors. Counting a list is useful only after its independence or spanning has been justified.
Let be a real vector space supplied with a finite spanning list . First prove that every independent list has length at most . After insertions, maintain a spanning list consisting of and surviving old vectors. Expand in this list. Some coefficient on a surviving old vector is nonzero; otherwise would be in the span of the earlier , contradicting independence. Solve for that old vector and replace it by . The new list spans the same space and keeps every earlier insertion. If , after steps the first independent vectors already span , contradicting independence of . This proves the bound, including .
Every subspace has a finite basis. Start with the empty independent list. If its current span is not , choose one vector of outside that span. A relation with nonzero coefficient on the new vector would express it in the old span, so the enlarged list remains independent. The proved bound permits at most additions; therefore the process stops with an independent spanning list for . If , it stops immediately with the empty basis. Starting instead with any given independent list in proves that list extends to a basis of . Only a bounded finite selection is used. Finally, if two bases have sizes , use each as the finite spanning list in the bound to obtain and . Thus basis size, called dimension, is well-defined. This supplies the existence, extension and dimension facts used in rank–nullity.
A map is linear if . Its kernel and image are subspaces. Choose a basis of and extend to a basis with . Then form a basis of : spanning follows by expanding any input; a dependence among these images places the corresponding input combination in the kernel, and independence of the extended basis makes all coefficients zero. Thus
This is rank–nullity. In equal finite dimensions, injectivity and surjectivity are equivalent, but the equivalence can fail in infinite-dimensional spaces.
One eigenvector is useful. A whole basis of eigenvectors is transformative. In this note the default scalar field is the real field : matrices, scalars, and vectors have real entries unless a complex extension is stated explicitly. Every argument is algebraic and also works over after replacing by .
If a square matrix has enough linearly independent eigenvectors, there is a coordinate system in which its action is diagonal. In that coordinate system, powers and inverses become entrywise calculations. The word “enough” is exact: for an matrix, we need linearly independent eigenvectors, so those vectors form a basis of .
The coordinate-conversion matrix is developed in Basis extension and change of basis.
Let be invertible. Write a vector in the original coordinates as , where contains its coordinates in the basis formed by the columns of . Set . Then
Thus acting on the original vector is represented by acting on the new coordinate vector . These two matrices describe one linear action in two bases. The matrix must be invertible before this interpretation makes sense: otherwise is not a coordinate system.
This viewpoint also explains why the equation is written with on the left. Start with a vector in the new coordinates, convert it to , apply the original matrix to obtain , and convert the output back by . The resulting new-coordinate action is exactly . A similarity calculation therefore preserves the map while changing the labels used for its inputs and outputs. It does not permit arbitrary replacement of one matrix by another: the conjugating matrix and its inverse record the coordinate conversion.
Definition
Two matrices and over the same field are similar if there exists an invertible such that
Definition
Let be an matrix. If there is an invertible matrix and scalars such that
then this equality is a diagonalization of and is diagonalizable.
Diagonalization is therefore a special similarity in which the target matrix has no off-diagonal entries. The diagonal entries are useful only when their order is tied to the columns of .
Theorem
Let be and let
be invertible. For scalars , set . The following statements are equivalent:
Proof
The column equation for each is exactly the matrix identity , because the th columns of the two sides are those two vectors. Since is invertible, left multiplication by gives ; right multiplication by gives . Conversely, each of those two equalities can be multiplied by on the appropriate side to recover , and then the column equations. The invertibility of is used before either cancellation step, and each is nonzero automatically because it is a column of an invertible matrix.
The dictionary prevents a common ordering error. If the first column of is an eigenvector for and the second is one for , then the diagonal is . Reordering the columns requires reordering the diagonal entries at the same time.
There is a useful rectangular version of the first step. If is an matrix and , then
is equivalent to for each listed column. This packages eigenvector equations even when . It is not yet a diagonalization: a rectangular has no inverse, and dependent columns do not supply a full coordinate system. Diagonalization begins only when and the columns are independent. Keeping this distinction prevents the phrase “these vectors diagonalize ” from being applied to a partial eigenvector list.
Theorem
An matrix over is diagonalizable if and only if it has linearly independent eigenvectors over . Equivalently, its eigenvectors can be chosen as a basis of .
For necessity, a diagonalization supplies the columns of an invertible , and the dictionary says that each column is an eigenvector. For sufficiency, choose independent eigenvectors as columns of . Independence makes invertible, and the dictionary supplies the diagonalization. Merely listing eigenvectors is not enough: repeated vectors or dependent choices do not make a coordinate basis.
In practice, a reliable construction has three separate checks. First solve and record the field over which the nullspace is being taken. Next place the selected vectors in a matrix in an explicitly stated order and test independence, for example by checking that its determinant is nonzero. Finally multiply and or compute ; one successful entry is not enough to certify a matrix identity. These checks separate the spectral question (which vectors exist) from the coordinate question (whether they form a basis) and from the arithmetic question (whether the displayed products were copied correctly).
Worked example
Let
Its characteristic polynomial is
For , the equation gives , so take . For , the equation gives , so take . Put them in that order:
The determinant of is , and
The column equations give , hence . For a coordinate check, take . Since with , we have
The diagonal calculation and the original matrix action agree.
The first example also illustrates why a diagonalization is a basis statement, not merely a convenient factorization. The columns of give every vector a unique pair of new coordinates. In those coordinates the first direction is scaled by and the second by ; converting back with recombines those two independent effects. If the columns were dependent, some vectors would have no coordinates or would have more than one coordinate description, so the formula would not represent a legitimate change of basis.
Worked example
Let
The following eigenvectors are
with eigenvalues . Form
Its determinant is , so it is invertible, with
Direct multiplication gives
Thus , and . The upper-triangular shape of was not itself the proof of diagonalizability; the independent eigenvectors and the invertible matrix they form were.
Worked example
Consider
Its only eigenvalue is , since . Solving
forces , while is free. Thus the eigenspace is , which has dimension one. A matrix needs two independent eigenvectors, so is not diagonalizable. A repeated eigenvalue can still allow diagonalization, but its eigenspace must have enough independent directions.
If is an permutation matrix and , then is also invertible and
The result is diagonal with the same entries reordered according to . This is why a diagonalization is not unique: eigenvectors may be placed in another simultaneous order. Rescaling an eigenvector column by a nonzero scalar also preserves its eigendirection, provided the corresponding column and diagonal ordering are kept aligned.
Theorem
If for invertible , then
Therefore similar matrices have the same characteristic polynomial and the same eigenvalues, counted with algebraic multiplicity.
The calculation uses and , followed by multiplicativity of the determinant. Similarity does not mean that the matrices have the same entries or the same eigenvectors; it means that corresponding eigenspaces are carried between coordinate systems by .
The characteristic-polynomial conclusion is one-way. It is safe to use equal characteristic polynomials as a quick obstruction: if the polynomials differ, the matrices cannot be similar. It is unsafe to reverse the implication, because the polynomial records aggregate eigenvalue information and can miss how eigenspaces and generalized directions are arranged. The nilpotent pair in the counterexample makes this limitation visible with the smallest nontrivial size.
Counterexample mode
The matrices
both have characteristic polynomial , but they are not similar. Every invertible matrix satisfies , whereas . Equal characteristic polynomials are necessary for similarity, not sufficient.
Theorem
Suppose , where is invertible and . Then for every positive integer ,
If is invertible, every is nonzero and . Also is diagonalizable with the same eigenvalues.
The positive-power statement starts at ; separately, and . Negative powers require invertibility: for an integer , the formula is only when every diagonal entry is nonzero. A zero diagonal entry makes and hence undefined.
The boundary cases are worth keeping separate. A matrix with a zero diagonal entry in may still have well-defined nonnegative powers, including , but it cannot have an inverse. If all diagonal entries are nonzero, then every integer power exists and the negative powers are obtained by replacing each with its reciprocal. This is a statement about the same fixed diagonalization; one must not silently choose a different ordering for each power, because the conjugating factors would then no longer cancel in the displayed product.
Proof
For , multiply the induction hypothesis by and cancel the adjacent :
For the inverse, invert the three factors in reverse order: . For the transpose,
Set ; then and . Thus the columns of are eigenvectors of . The original columns of need not be eigenvectors of .
Worked example
Let
and take
The three columns of are eigenvectors, so . For every positive integer ,
At this gives diagonal entries and off-diagonal entries , which recovers . At , the diagonal entries are and the off-diagonal entries are , matching direct multiplication. The symbolic power is useful because no new eigenvector calculation is needed for another positive .
Over , the matrix
has characteristic polynomial , so it has no real eigenvalues and is not diagonalizable over . Over , use
Then ; the complex diagonalization is valid because . This is a field extension, not a contradiction of the real criterion.
Theorem
Suppose and for the same invertible , where and are diagonal. For any scalars ,
Both right-hand middle matrices are diagonal, so these matrices are simultaneously diagonalizable by .
Indeed, distribute and use : and . The same eigenbasis hypothesis is essential; separate diagonalizability of and does not by itself give a common .
The characteristic polynomial counts algebraic multiplicity, while the dimension of an eigenspace counts available independent eigenvectors. These numbers are related but answer different questions. If a repeated eigenvalue has an eigenspace whose dimension is too small, no rearrangement of columns can create the missing directions. The matrix demonstrates this obstruction. If the eigenspace has enough dimension, repeated diagonal entries cause no problem; a diagonal matrix itself may have the same eigenvalue many times and still have a complete eigenbasis.
Similarity preserves the characteristic polynomial because it preserves the linear map under a coordinate conversion. It also carries an eigenspace for to the corresponding eigenspace for : if and , then . The vector remains nonzero because is invertible. This explains why eigenvalues agree while the literal eigenvectors usually differ. It also clarifies the limitation of the polynomial invariant: the polynomial records eigenvalue data, not the full arrangement of eigenspaces.
To decide diagonalizability over the stated field, find every eigenvalue and add the dimensions of its eigenspace. The total is exactly when an matrix has an eigenbasis. Assemble an ordered basis as the columns of , use the same eigenvalue order in , and verify together with the invertibility of . These two checks establish the claimed diagonalization without requiring a second computation of .
Checkpoint
Use the equation .
The columns must be linearly independent eigenvectors of , forming an eigenbasis; the th column corresponds to the th diagonal entry of .
Checkpoint
Use the exact criterion.
No. If it is diagonalizable, its maximum number of linearly independent eigenvectors is three, so it cannot be two.
Checkpoint
Use the characteristic-polynomial invariant.
Yes. Similar matrices have the same characteristic polynomial and therefore the same eigenvalues, with algebraic multiplicity.
Checkpoint
Match the diagonal order to the column order.
If , then
The entries must match the eigenvalues attached to the selected columns.
Checkpoint
Find the dimension of its eigenspace.
Its only eigenvalue is , and forces . The eigenspace is one-dimensional, but a matrix needs two independent eigenvectors.
Checkpoint
Use the positive-power formula.
Read 8.1 Eigenvalues, eigenvectors, and eigenspaces first if the homogeneous-system viewpoint is not yet solid. Continue with 8.3 Characteristic polynomials and diagonalization tests for polynomial tools that test whether enough eigenvectors exist. The basis language here also depends on 6.5 Basis and dimension.