Loading…
Meet diagonal, triangular, identity, and elementary matrices, and see why their special shapes shorten later arguments.
Not every matrix deserves a special name. The families in this note do because their visible patterns impose algebraic restrictions. Once those restrictions are translated into index notation, they let us predict products, transposes, and row operations without expanding every entry.
Throughout the note, entries come from a field , usually in this course. Statements about diagonal and triangular matrices concern square matrices unless another size is stated explicitly.
A general matrix contains entries, and none of them is forced by shape alone. A special matrix carries extra information before any calculation begins. For example, knowing that a matrix is lower triangular immediately tells us that every entry with is zero. That single condition controls many later computations.
The point of naming matrix families is therefore not classification for its own sake. A good name compresses a useful hypothesis:
These descriptions are related rather than disjoint. In particular, a diagonal matrix is simultaneously upper triangular and lower triangular. The identity matrix is diagonal, hence belongs to both triangular families as well. A matrix can therefore carry several useful labels at once.
The advantage becomes clearest in proofs. To show that a product of two lower triangular matrices is lower triangular, we do not need to calculate all entries. We only examine an arbitrary entry above the diagonal and show, by splitting its row-by-column sum into two index ranges, that every term must vanish. This is a model for how structural information replaces brute force.
Definition 3.4.1
(Diagonal, triangular, identity, and elementary matrices)
Let .
The matrix is diagonal when whenever . We write
It is upper triangular when for , so every entry below the main diagonal is zero. It is lower triangular when for , so every entry above the main diagonal is zero. Consequently, a matrix is diagonal exactly when it is both upper triangular and lower triangular.
The identity matrix is the diagonal matrix .
An elementary matrix of order is obtained from by exactly one elementary row operation: interchanging two rows, multiplying one row by a nonzero scalar, or adding a scalar multiple of one row to another.
The words “above” and “below” refer to indices, not to the signs of the entries: is above the diagonal when , on it when , and below it when . Diagonal entries themselves are unrestricted in a triangular matrix; in particular, they may be zero.
Forced zero positions distinguish diagonal and triangular matrices; the identity and elementary matrices are also characterized by their multiplication rules.
Classify special matrix families by their visible shape, then connect diagonal and triangular closure, the identity law, and elementary matrices as row-operation packages.
Family map
Diagonal, triangular, identity, zero, and elementary matrices are useful because their shape carries algebraic information.
Diagonal pattern
A diagonal matrix has all off-diagonal entries equal to zero, and the product of two diagonal matrices is still diagonal.
Triangular pattern
An upper triangular matrix has zeros below the main diagonal, and multiplying upper triangular matrices preserves that zero side.
Identity action
The identity matrix is diagonal with ones on the diagonal; compatible products satisfy AI_n = A and I_mA = A.
Elementary bridge
An elementary matrix is obtained by applying one elementary row operation to an identity matrix.
Side matters
Multiplying by E on the left performs the matching row operation on A, while multiplying on the right performs the corresponding column operation.
Special matrix families are not just names. Diagonal, triangular, identity, zero, and elementary matrices package visible structure, so you should classify the shape before deciding how much computation is really needed.
The following widget concentrates on diagonal, identity, symmetric, and skew-symmetric recognition. Its labels are intentionally not an exhaustive list of matrix families: a matrix shown as “neither” in that narrower comparison may still be upper or lower triangular. Use the entries themselves, rather than a single label, when applying the definitions in this note.
Classify matrix families by transpose comparison
Pick a matrix and compare with entry by entry. Which of the four families does it belong to?
| 2 | −1 |
| −1 | 5 |
| 2 | −1 |
| −1 | 5 |
equals entry by entry.
Holds: is symmetric ()
Symmetric. The transpose matches the original matrix entry by entry, so .
NoticeEach family is a condition on every entry of ; a single failing entry rules the family out.
Theorem 3.4.2
(Transpose exchanges the two triangular families)
Let . Then is upper triangular if and only if is lower triangular. Likewise, is lower triangular if and only if is upper triangular. A diagonal matrix therefore remains diagonal after transposition.
Theorem 3.4.3
(Triangular matrices are closed under multiplication)
Let . If both matrices are lower triangular, then is lower triangular. If both are upper triangular, then is upper triangular.
As a special case, the product of two diagonal matrices of order is diagonal.
Theorem 3.4.4
(Elementary left multiplication performs a row operation)
Suppose is obtained by applying one elementary row operation to . For every , the product is defined and is exactly the matrix obtained by applying to the rows of .
The size conditions are part of these statements. Closure under multiplication requires matrices of the same order, while the elementary-matrix theorem only requires the number of rows of to equal the order of .
For the transpose theorem, suppose is upper triangular. To prove that is lower triangular, choose a position above its diagonal, so . By the definition of transpose,
Since , the entry lies below the diagonal of the upper triangular matrix , and is therefore zero. Hence every entry above the diagonal of vanishes. The reverse implication follows by applying the same argument to and using . Interchanging “upper” and “lower” gives the second equivalence.
The multiplication theorem needs a little more care. Let and be lower triangular matrices. Fix any position above the diagonal; thus . The corresponding entry of the product is
Split the possible values of into the two exhaustive cases and .
Thus every term in the sum is zero, regardless of . Therefore for every , proving that is lower triangular for arbitrary , not merely in the case. The upper triangular result follows either from the analogous index argument or from and the transpose theorem.
Because a diagonal matrix is both upper and lower triangular, the product of two diagonal matrices is also both, hence diagonal. More explicitly,
This formula also shows that two diagonal matrices of the same order commute. It does not imply that arbitrary upper or lower triangular matrices commute.
There is a second consequence hidden in the same index structure. If and are both lower triangular, then for a diagonal position ,
Indeed, when , the factor is above the diagonal of and is zero; when , the factor is above the diagonal of and is zero. Only can contribute. The same diagonal-entry formula holds for products of upper triangular matrices. This observation will later connect triangular shape with determinants and invertibility.
Finally, the elementary-matrix theorem follows from how matrix multiplication forms rows. The rows of are the standard row vectors. Performing on those rows produces the rows of . When multiplies , the same coefficients form the rows of from the rows of . Checking the three elementary operation types gives respectively a row interchange, a nonzero row scaling, and a row replacement.
Worked example 3.4.5
(Identify every applicable matrix family)
Consider
The matrix is diagonal because all six off-diagonal entries are zero. It is therefore both upper triangular and lower triangular. It is also symmetric because .
The matrix is upper triangular because its entries with are zero. It is not diagonal, since entries such as above the diagonal are nonzero, and it is not lower triangular for the same reason.
The identity matrix
is an especially important diagonal matrix. Hence it is upper triangular, lower triangular, and symmetric. None of these classifications requires a separate calculation once the defining zero pattern has been read correctly.
Worked example 3.4.6
(Transpose a triangular matrix and track its indices)
Let
Then
The zero , for example, becomes . In general, every below-diagonal position of becomes the above-diagonal position of . Thus the displayed calculation illustrates the index proof rather than replacing it.
As a quick numerical closure check, take
Then
which is lower triangular. This one example is evidence, while the arbitrary index proof establishes the theorem for every order .
Worked example 3.4.7
(Diagonal matrices and an elementary matrix: rows versus columns)
Let
The dimensions determine which diagonal matrix can appear on each side: is times , whereas is times . Direct multiplication gives
Left multiplication by a diagonal matrix scales rows: the two diagonal entries of multiply rows 1 and 2. Right multiplication scales columns: the three diagonal entries of multiply columns 1, 2, and 3.
Now form the elementary matrix
obtained from by . Then
The first row is unchanged and the second is , exactly as the elementary left multiplication theorem predicts. Right multiplication by would not even be defined here, because the inner dimensions and do not match.
The zero pattern also survives addition and scalar multiplication. If and are lower triangular of order , then for every ,
For any scalar , in the same positions. Thus the sum, difference, and scalar multiple of lower triangular matrices remain lower triangular; the upper triangular and diagonal families have the analogous property. These statements require the matrices being added to have the same dimensions. They are simpler than the multiplication theorem because addition compares matching entries, whereas multiplication mixes an entire row with an entire column.
Closure must not be confused with commutativity. Consider the two upper triangular matrices
Both products remain upper triangular, as the theorem promises, but
Hence . Diagonal matrices commute with one another because their products are computed entry by entry on the diagonal; a diagonal matrix does not necessarily commute with a nondiagonal triangular matrix.
Nor does the theorem cover a product of different triangular types. For
we obtain
which is neither upper nor lower triangular. The closure theorem assumes that both factors belong to the same triangular family; a mixed product must be analysed from its actual entries.
Repeated multiplication gives another immediate consequence. If is upper triangular, then every positive power is upper triangular: start with and apply multiplication closure at each step. The same is true for lower triangular and diagonal matrices. This is an induction argument; it does not say that unrelated operations preserve the same orientation. Transposition, for instance, turns upper triangular shape into lower triangular shape unless the matrix has further restrictions.
The identity matrix behaves in matrix multiplication as the scalar does in ordinary multiplication, but its order must match the side on which it appears. If is , then
The two identity matrices need not have the same size when . Entrywise, let when and otherwise. Then
This explains why identity matrices occur in inverse problems: a square matrix is invertible precisely when another matrix satisfies . Triangular shape alone does not guarantee invertibility; a triangular matrix with a zero diagonal entry is singular.
Every elementary matrix is invertible because its defining row operation can be undone by another elementary row operation. The detailed construction of all three types, products of several elementary matrices, and their inverses continues in 3.5 Elementary row-operation matrices.
Common mistake
(Using “triangular” as if it meant “diagonal”)
Every diagonal matrix is both upper triangular and lower triangular. A matrix that is only upper triangular or only lower triangular may have nonzero entries off the diagonal, so the converse is false.
Common mistake
(Testing the wrong side of the diagonal)
For an upper triangular matrix, entries with —below the diagonal—must vanish. For a lower triangular matrix, entries with —above the diagonal—must vanish.
Common mistake
(Assuming triangular means invertible)
A triangular matrix may have zero diagonal entries. Triangular shape by itself does not imply invertibility; the later determinant criterion will require every diagonal entry to be nonzero.
Common mistake
(Ignoring dimensions or the side of multiplication)
For , the valid identity equations are and . Likewise, left multiplication by an elementary matrix performs a row operation; right multiplication, when defined, acts on columns instead.
Common mistake
(Treating an elementary matrix as an arbitrary matrix)
An elementary matrix is obtained from an identity matrix by exactly one elementary row operation. A product of several elementary matrices is invertible, but need not itself be elementary.
Special matrices turn visible zero patterns into reusable algebra. A diagonal matrix has all off-diagonal entries equal to zero and is therefore both upper and lower triangular. Transposition exchanges the upper and lower triangular families. Multiplication preserves each triangular family: for a lower triangular product, the split or forces one factor in every term above the diagonal to be zero.
Identity matrices preserve compatible matrices on either side, with acting on the rows of an matrix and acting on its columns. Diagonal left and right multipliers scale rows and columns respectively. An elementary matrix goes further by recording one reversible row operation, and left multiplication applies that operation to every column of the target matrix at once.
Quick check
(Why is every diagonal matrix automatically upper triangular and lower triangular?)
Answer by referring to the off-diagonal entries.
In a diagonal matrix, every off-diagonal entry is zero. Thus all entries below the diagonal satisfy the upper triangular condition, and all entries above the diagonal satisfy the lower triangular condition.
Quick check
(What does the identity matrix do when you multiply a compatible matrix by it?)
State the effect in words and remember that the order depends on the side.
It leaves the matrix unchanged: if is , then and .
Quick check
(Why does the product of two lower triangular matrices remain lower triangular?)
Do not multiply every entry. Explain why the entries above the diagonal stay zero.
For an entry above the diagonal, . In , if , then and ; if , then . Every summand is therefore zero, so every entry above the diagonal of is zero. The same argument works with replaced by any .
Quick check
(Give one reason the identity matrix belongs to more than one matrix family.)
Name at least two families and justify the classification from the entries.
The identity matrix is diagonal because every off-diagonal entry is zero. Therefore it is also both upper triangular and lower triangular. It is symmetric as well, since .
Review 3.3 Transpose, symmetric, and skew-symmetric matrices for the transpose rules used above.
Continue to 3.5 Elementary row-operation matrices for the full algebra of elementary matrices.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Compute (a) AB,BA; (b) verify both matrices are idempotent; (c) for real p,q verify the square formula and prove the power formula below by induction for every positive integer n.
For an efficient verification of (a),(b), put u=(−1,1,−1)ᵀ and v=(1,−2,−4)ᵀ. Then B=uvᵀ, vᵀu=1, and A=I−B. Consequently B²=u(vᵀu)vᵀ=B, A²=I−2B+B²=A, AB=BA=B−B²=0. Expanding the square gives (c.i). For (c.ii), n=1 is immediate. Assuming the formula at k, multiplication on the right gives the displayed induction step. This covers every real p,q, including zero.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Verify A is involutory, meaning A²=I₃.
The equality A=I₃+uvᵀ follows by writing out its entries. Associativity gives (uvᵀ)²=u(vᵀu)vᵀ. The scalar vᵀu equals −2 for every real r, so the computation proves involutoricity without dividing by any parameter.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Compute A²,A³,A⁴.
In A², the only possible nonzero entries are (1,3), (1,4), (2,4): their sums are a·a, a·a²+a²·a, a·a. Multiplying this result by A leaves only (1,4)=a²·a in A³. Its sole nonzero column position is 4, but row 4 of A is zero; hence A⁴=0. The formulas also hold for a=0.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
For n≥1: (a) prove that A=αIₙ or A=βIₙ or A=γIₙ implies (A−αIₙ)(A−βIₙ)(A−γIₙ)=O. (b) Disprove the converse by a counterexample.
In (a), the relevant factor is the zero matrix in each of the three cases; a product containing a compatible zero factor is zero. In (b), diagonal multiplication proves the required zero product. A has two different diagonal entries, whereas each scalar identity has equal diagonal entries. Thus it equals none of the three matrices, disproving the universal converse.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Prove A and B are both idempotent.
Use the two hypotheses and associativity in exactly the displayed order. Each matrix has square equal to itself, which is the definition of idempotence. No cancellation is needed.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
For n≥1: (a) prove A²=Iₙ implies (Iₙ+A)(Iₙ−A)=O; (b) determine whether the converse is true, with justification.
The first identity uses distributivity and multiplication by Iₙ. If A is involutory it gives zero, proving (a). The same identity also gives the reverse implication, so (b) is true.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Use induction to prove A(Iₙ+A)^m=A for every positive integer m.
The base case is m=1. For the step assume the desired equality holds at k≥1; associativity and the induction hypothesis give the displayed computation. Mathematical induction now proves the assertion for all positive m.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Compute (a) Q²,Q³,Q⁴ explicitly; (b) guess an explicit formula for Q^n for every positive integer n and prove it by induction.
Repeated multiplication gives (a). For (b), n=1 has S₁=1 and reproduces Q. Suppose the formula holds at n=k. In Q^kQ, the first entry is , and each other first-row entry is (a^k+S_k) times b,c,d respectively; the bottom three rows stay those of I₄. Since =S_k+a^k, the formula holds at k+1. Finally (a−1)S_n=a^n−1 by cancellation in the finite sum; division is valid because a≠1.
All matrices and unspecified scalar parameters in this solution are over the real numbers. Matrix dimensions are positive integers; O denotes the zero matrix of the displayed compatible size.
Use induction to prove: for every integer n>2 there are real numbers bₙ,cₙ,dₙ such that A^n=bₙA²+cₙA+dₙI₃.
The given polynomial identity supplies the base case n=3. Assuming the representation at k≥3, multiply by A and substitute A³=3A²−4A+2I₃. The displayed recurrence defines real coefficients for the next exponent, proving existence for every integer n>2. Uniqueness of these coefficients is neither claimed nor needed.