Linear algebra (Osnabrück 2024-2025)/Part II/Lecture 53

< Linear algebra (Osnabrück 2024-2025) < Part II



Norm of an endomorphism and of a matrix

Let and be finite-dimensional normed -vector spaces, and let denote a linear mapping. The

is called the Norm of .

More precisely, this norm is called the supremum norm, or the maximum norm. This is indeed a norm on the finite-dimensional -vector space . It is a special case of the supremum norm from exercise sheet 31, when we refer to the inclusion . In this situation, we can take the maximum instead of the supremum, because the supremum is obtained, due to the compactness of the sphere (with respect to the given norm) . This norm depends on the chosen norms on and ; however, because of Theorem 52.16 , the topology on the homomorphism space is for every norm the same. An important estimate is

for all , see Exercise 53.27 .

For and , we obtain for fixed norms on these spaces different norms on the matrix space

Because of

we can endow the matrix space also with the Euclidean norm, the maximum norm (with respect to the matrix entries), and the sum norm. Moreover, there exist further norms, which take the matrix structure into account. Let the matrix be given. We call

the column sum norm, and

the row sum norm. The column sum norm is the maximum norm in the sense of Definition, when both spaces are endowed with the sum norm; see Exercise 53.4 .



Convergence of matrix powers

For a complex number , the convergence behavior of the powers , , depends essentially on the modulus of the number. For , the sequence converges to ; for , the sequence is bounded, and it only converges for , for , the sequence is divergent. The corresponding questions also makes sense for powers of square matrices with entries in . All these powers lie in . As this is a finite-dimensional complex vector space, the convergence does not, according toin ihm nach Theorem 52.16 , depend on the chosen norm. For a diagonal matrix

the convergence behavior of the powers

depends directly on the entries in the diagonal. For example, the powers of the matrix converges to the zero matrix if and only if the modulus of every diagonal entry is smaller than .


Let

with . Then, according to Exercise 28.14 , we have

For

this matrix sequence converges to the zero matrix, because every entry converges to ; for

the sequence does not converge, because the entry in the right upper corner does converges; in fact, it is not even bounded. This is also true for .

The convergence of matrix powers is strongly related to the eigenvectors of the matrix.


Let be a finite-dimensional -vector space, and let

be an endomorphism. Let be such that the sequence converges. Then the limit vector

is the zero vector, or an eigenvector of for the eigenvalue

.

Let denote the limit vector. Then

holds for all . Because of the continuity (according to Theorem 52.17 ) of , the limit and the mapping may be swapped (according to Theorem 52.13 ). That is,

Therefore, is a fixed point of ; that means, it is the zero vector, or an eigenvector for the eigenvalue .



Let be a finite-dimensional -vector space, and let

be a trigonalizable endomorphism, with the decomposition (in the sense of Theorem 28.1 )

with a diagonalizable and a nilpotent mapping, commuting with each other, and with

Then the powers of have the representation

This follows directly from

the commuting property, and the general binomial formula.



Asymptotic stability and stability

Let be a finite-dimensional -vector space, and let

be an endomorphism. Then is called asymptotically stable if the sequence converges in to the

zero mapping.

In the real situation, also the complex eigenvalues are important. These are the complex zeroes of the characteristic polynomial, and also the eigenvalues of the matrix when considered over . They are not eigenvalues of the real matrix in the sense of the Definition. We will also use the Jordan normal form, which in general exists only in the complex case, in the real situation.


Let be a finite-dimensional -vector space, and let

be an

endomorphism. Then the following properties are equivalent.
  1. is asymptotically stable.
  2. For every , the sequence , , converges to .
  3. There exists a generating system such that , , converges to .
  4. The modulus of every complex eigenvalues of is smaller than .

(1) implies (2). Let . We can work with an arbitrary norm on and on the endomorphism space, for example, with the maximum norm. Because of

the sequence converges to . From (2) to (3) is clear. If (3) holds, and

is a linear combination, then

and the convergence of the sequences to implies the convergence of this sum sequence to . From (2) or (3) to (4). We may assume : In the real case, we can stick to , and the mapping is given by a real matrix, which we can consider as a complex matrix. The given real generating system is also a complex generating system for . Let be an eigenvalue and be an eigenvector of . Due to the condition,

converges to ; therefore, converges to , and so

To get the implication from (4) to (1), we use Lemma 53.4 . We have

where is the order of nilpotency of the nilpotent part . The eigenvalues of are according to Exercise 28.13 the eigenvalues of the diagonalizable part ; we denote them by . The summands are of the form

for a fixed , and a polynomial . The diagonal entries of are (after diagonalization) of the form

because of , this converges for to . Therefore, converges to the zero mapping, and this holds due to Exercise 53.7 also for the product with the fixed mapping . Hence, the sum converges to the zero mapping.



Let be a finite-dimensional -vector space, and let

be an endomorphism. The spectral radius of is

In the finite-dimensional case there are only finitely many (complex) eigenvalues; therefore, the spectral radius is well-defined. According to Theorem 53.6 , the endomorphism is asymptotically stable if and only if the spectral radius . We stress that in the real situation, the spectral radius is determined using the corresponding complex situation.


Let be a finite-dimensional -vector space, and let

be an endomorphism. Let a norm on be given, and let be the corresponding norm on the endomorphism space. Then the spectral radius satisfies die estimate

Let be an eigenvalue of with

Let be an eigenvector of . Then

and division by yields the claim.



Let be a finite-dimensional -vector space, and let

be an endomorphism. Then is called stable if the sequence in is

bounded.

For example, the following theorem entails that an isometry on a Euclidean space is stable, since for every vector the norms are even constant.


Let be a finite-dimensional -vector space, and let

be an

endomorphism. Then the following properties are equivalent.
  1. is stable.
  2. For every , the sequence , , is bounded.
  3. There exists a generating system such that , , is bounded.
  4. The modulus of every complex eigenvalue of is smaller or equal , and the eigenvalues of modulus are diagonalizable, that is, their algebraic multiplicity equals their geometric multiplicity.
  5. For a describing matrix of , considered over , the Jordan blocks of the Jordan normal form have the form

    with , or the form with .

(1) implies (2). Let . We can work with an arbitrary norm on and on the endomorphism space; for example, with the maximum norm. Because of

is bounded. From (2) to (3) is clear. If (3) is fulfilled, and

is a linear combination, then

The boundedness of the sequences implies the boundedness of this sum sequence. The equivalence between (4) and (5) is clear, because over the Jordan normal form exists, and the eigenvalues and their multiplicities can be read off from the Jordan blocks. From (2) to (5). We may assume . Let

be a Jordan block of the Jordan normal form. In case

for a corresponding eigenvector we obtain

directly contradicting boundedness. So let

and assume that the length of the Jordan block is at least two. Due to Exercise 53.21 , we have

Here, the first component is

which is not bounded contradicting the condition.

To conclude from (5) to (1), we may consider each Jordan block separately, because, according to Exercise 53.19 , stability is compatible with a direct sum decomposition. For the first type, the statement follows from Theorem 53.6 . For the type with , the statement is clear, because the norms of the powers equal .


For the convergence the matrix powers, we have the following characterization.


Let be a finite-dimensional -vector space, and let

be an

endomorphism. Then the following properties are equivalent.
  1. The sequence converges in .
  2. For every , the sequence , converges
  3. There exists a generating system such that , , converges.
  4. The modulus of every complex eigenvalue of issmaller or equal , and if its modulus is , then the eigenvalue equals , and it is diagonalizable.
  5. For a describing matrix of , considered over , the Jordan blocks of the Jordan normal form are

    with , or equal .

Proof


<< | Linear algebra (Osnabrück 2024-2025)/Part II | >>
PDF-version of this lecture
Exercise sheet for this lecture (PDF)