# Mathematics for Applied Sciences (Osnabrück 2023-2024)/Part I/Lecture 26/refcontrol

    Rank of matrices

## Definition

Let $K$ be a field,MDLD/field and let $M$ denote an $m\times n$-matrixMDLD/matrix over $K$. Then the dimensionMDLD/dimension (fgvs) of the linear subspaceMDLD/linear subspace of $K^{m}$, generated by the columns, is called the column rank of the matrix, written
    $\operatorname {rk} \,M.$

## LemmaCreate referencenumber

Let $K$ denote a field,MDLD/field and let $V$ and $W$ denote $K$-vector spacesMDLD/vector spaces of dimensions $n$ and $m$. Let
    $\varphi \colon V\longrightarrow W$
be a linear mappingMDLD/linear mapping which is described by the matrixMDLD/matrix $M\in \operatorname {Mat} _{m\times n}(K)$, with respect to basesMDLD/bases (vs) of the spaces. Then
    $\operatorname {rk} \,\varphi =\operatorname {rk} \,M\,$

### Proof

$\Box$
To formulate the next statement, we introduce row rank of an $m\times n$-matrix to be the dimension of the linear subspace of $K^{n}$ generated by the rows.

## LemmaLemma 26.3 change

Let $K$ be a field,MDLD/field and let $M$ denote an $m\times n$-matrixMDLD/matrix over $K$. Then the column rankMDLD/column rank coincides with the row rank.MDLD/row rank If $M$ is transformed with elementary row manipulations to a matrix $M'$ in the sense of Theorem 21.9 ,
$M'$

### Proof

Let $r$ denote the number of the relevant rows in the matrix $M'$ in echelon form, gained by elementary row manipulations. We have to show that this number is the column rank, and the row rank of $M'$ and of $M$. In an elementary row manipulation,MDLD/elementary row manipulation the linear subspace generated by the rows is not changed, therefore the row rank is not changed. So the row rank of $M$ equals the row rank of $M'$. This matrix has row rank $r$, since the first $r$ rows are linearly independent,MDLD/linearly independent and beside this, there are only zero rows. But $M'$ has also column rank $r$, since the $r$ columns, where there is a new step, are linearly independent, and the other columns are linear combinationsMDLD/linear combinations of these $r$ columns. By Exercise 26.2 , the column rank is preserved by elementary row manipulations.
$\Box$
Both ranks coincide, so we only talk about the rank of a matrix.

## CorollaryCorollary 26.4 change

Let $K$ be a field,MDLD/field and let $M$ denote an $n\times n$-matrixMDLD/matrix
$K$
* $M$ is invertible.
* The rankMDLD/rank (matrix) of $M$ is $n$.
* The rows of $M$ are linearly independent.MDLD/linearly independent
* The columns of $M$ are linearly independent.

### Proof

The equivalence of (2), (3) and (4) follows from the definition and from Lemma 26.3 . For the equivalence of (1) and (2), let's consider the linear mappingMDLD/linear mapping
    $\varphi \colon K^{n}\longrightarrow K^{n}$
defined by $M$. The property that the column rank equals $n$, is equivalent with the map being surjective, and this is, due to Corollary 25.4 , equivalent with the map being bijective. Because of Lemma 25.11 , bijectivity is equivalent with the matrix being invertible.MDLD/invertible (matrix)
$\Box$
    Determinants

## Definition

Let $K$ be a field,MDLD/field and let $M$ denote an $n\times n$-matrixMDLD/matrix over $K$ with entries $a_{ij}$. For $i\in \{1,\ldots ,n\}$, let $M_{i}$ denote the $(n-1)\times (n-1)$-matrix, which arises from $M$, when we remove the first column and the $i$-th row. Then one defines recursively the determinant of $M$ by
    $\det M={\begin{cases}a_{11}\,,&{\text{ for }}n=1\,,\\\sum _{i=1}^{n}(-1)^{i+1}a_{i1}\det M_{i}&{\text{ for }}n\geq 2\,.\end{cases}}\,$
The determinant is only defined for square matrices. For small $n$, the determinant can be computed easily.

## Example Create referencenumber

For a $2\times 2$-matrixMDLD/matrix
    $M={\begin{pmatrix}a&b\\c&d\end{pmatrix}}\,,$
we have
    $\det {\begin{pmatrix}a&b\\c&d\end{pmatrix}}=ad-cb.$

## Example Create referencenumber

For a $3\times 3$-matrixMDLD/matrix $M={\begin{pmatrix}a_{11}&a_{12}&a_{13}\\a_{21}&a_{22}&a_{23}\\a_{31}&a_{32}&a_{33}\end{pmatrix}}$, we have
    $\det {\begin{pmatrix}a_{11}&a_{12}&a_{13}\\a_{21}&a_{22}&a_{23}\\a_{31}&a_{32}&a_{33}\end{pmatrix}}=a_{11}a_{22}a_{33}+a_{12}a_{23}a_{31}+a_{13}a_{21}a_{32}-a_{13}a_{22}a_{31}-a_{11}a_{23}a_{32}-a_{12}a_{21}a_{33}.$
This is called the rule of Sarrus.

## LemmaLemma 26.8 change

For an upper triangular matrixMDLD/upper triangular matrix
    $M={\begin{pmatrix}b_{1}&\ast &\cdots &\cdots &\ast \\0&b_{2}&\ast &\cdots &\ast \\\vdots &\ddots &\ddots &\ddots &\vdots \\0&\cdots &0&b_{n-1}&\ast \\0&\cdots &\cdots &0&b_{n}\end{pmatrix}}\,,$
    $\det M=b_{1}b_{2}\cdots b_{n-1}b_{n}\,.$
identity matrixMDLD/identity matrix we get
$\det E_{n}=1$

### Proof

This follows with a simple induction directly from the recursive definition of the determinant.MDLD/determinant (rec)
$\Box$
    Multilinearity
We want to show that the recursively defined determinant is a "multilinear“ and "alternating“ mapping, where we identify
    $\operatorname {Mat} _{n}(K)\cong (K^{n})^{n}\,,$
so a matrix is identified with the $n$-tuple of the rows of the matrix. We consider a matrix as a tuple of columns
    ${\begin{pmatrix}v_{1}\\\vdots \\v_{n}\end{pmatrix}}$
where the entries $v_{i}$ are row vectors of length $n$.

## TheoremTheorem 26.9 change

Let $K$ be a field, and $n\in \mathbb {N} _{+}$. Then the determinantMDLD/determinant
    $\operatorname {Mat} _{n}(K)=(K^{n})^{n}\longrightarrow K,M\longmapsto \det M,$
is multilinear.MDLD/multilinear This means that for every $k\in \{1,\ldots ,n\}$, and for every choice of $n-1$ vectors $v_{1},\ldots ,v_{k-1},v_{k+1},\ldots ,v_{n}\in K^{n}$, and for any $u,w\in K^{n}$, the identity
    $\det {\begin{pmatrix}v_{1}\\\vdots \\v_{k-1}\\u+w\\v_{k+1}\\\vdots \\v_{n}\end{pmatrix}}=\det {\begin{pmatrix}v_{1}\\\vdots \\v_{k-1}\\u\\v_{k+1}\\\vdots \\v_{n}\end{pmatrix}}+\det {\begin{pmatrix}v_{1}\\\vdots \\v_{k-1}\\w\\v_{k+1}\\\vdots \\v_{n}\end{pmatrix}}\,$
holds, and for $s\in K$, the identity
    $\det {\begin{pmatrix}v_{1}\\\vdots \\v_{k-1}\\su\\v_{k+1}\\\vdots \\v_{n}\end{pmatrix}}=s\det {\begin{pmatrix}v_{1}\\\vdots \\v_{k-1}\\u\\v_{k+1}\\\vdots \\v_{n}\end{pmatrix}}\,$

### Proof

$\Box$

## TheoremTheorem 26.10 change

Let $K$ be a field,MDLD/field and $n\in \mathbb {N} _{+}$. Then the determinantMDLD/determinant
    $\operatorname {Mat} _{n}(K)=(K^{n})^{n}\longrightarrow K,M\longmapsto \det M,$
* If in $M$ two rows are identical, then $\det M=0$. This means that the determinant is alternating.MDLD/alternating
* If we exchange two rows in $M$, then the determinant changes with factor $-1$.

### Proof

$\Box$

## TheoremTheorem 26.11 change

Let $K$ be a field,MDLD/field and let $M$ denote an $n\times n$-matrixMDLD/matrix
$K$
* We have $\det M\neq 0$.
* The rows of $M$ are linearly independent.MDLD/linearly independent
* $M$ is invertible.MDLD/invertible (matrix)
* We have $\operatorname {rk} \,M=n$.

### Proof

The relation between rank, invertibility and linear independence was proven in Corollary 26.4 . Suppose now that the rows are linearly dependent.MDLD/linearly dependent After exchanging rows, we may assume that $v_{n}=\sum _{i=1}^{n-1}s_{i}v_{i}$. Then, due to Theorem 26.9
and Theorem 26.10 , we get
    $\det M=\det {\begin{pmatrix}v_{1}\\\vdots \\v_{n-1}\\\sum _{i=1}^{n-1}s_{i}v_{i}\end{pmatrix}}=\sum _{i=1}^{n-1}s_{i}\det {\begin{pmatrix}v_{1}\\\vdots \\v_{n-1}\\v_{i}\end{pmatrix}}=0\,.$
Now suppose that the rows are linearly independent. Then, by exchanging of rows, scaling and addition of a row to another row, we can transform the matrix successively into the identity matrix. During these manipulations, the determinant is multiplied with some factor $\neq 0$. Since the determinant of the identity matrix is $1$, the determinant of the initial matrix is $\neq 0$.
$\Box$

## Remark

In case $K=\mathbb {R}$, the determinantMDLD/determinant is in tight relation to volumes of geometric objects. If we consider in $\mathbb {R} ^{n}$ vectors $v_{1},\ldots ,v_{n}$, then they span a parallelotope. This is defined by
    $P:={\left\{s_{1}v_{1}+\cdots +s_{n}v_{n}\mid s_{i}\in [0,1]\right\}}\,.$
It consists of all linear combinationsMDLD/linear combinations of these vectors, where all the scalars belong to the unit interval. If the vectors are linearly independent, then this is a "voluminous“ body, otherwise it is an object of smaller dimension. Now the relation
    $\operatorname {vol} \,P=\vert {\det {\left(v_{1},\ldots ,v_{n}\right)}}\vert \,$
holds, saying that the volume of the parallelotope is the modulus of the determinant of the matrix, consisting of the spanning vectors as columns.
    The multiplication theorem for determinants
We discuss without proofs further important theorems about the determinant. The proofs rely on a systematic account of the properties which are characteristic for the determinant, namely the properties multilinear and alternating. By these properties, together with the condition that the determinant of the identity matrix is $1$, the determinant is already determined.

## TheoremCreate referencenumber

Let $K$ denote a field, and $n\in \mathbb {N} _{+}$. Then for matrices $A,B\in \operatorname {Mat} _{n}(K)$, the relation
    $\det {\left(A\circ B\right)}=\det A\cdot \det B\,$

### Proof

$\Box$

## Definition

Let $K$ be a field,MDLD/field and let $M=(a_{ij})_{ij}$ be an $m\times n$-matrixMDLD/matrix over $K$. Then the $n\times m$-matrix
    ${M^{\text{tr}}}={\left(b_{ij}\right)}_{ij}{\text{ with }}b_{ij}:=a_{ji}$
$M$
The transposed matrix arises by interchanging the role of the rows and the columns. For example, we have
    ${{\begin{pmatrix}t&n&o&d\\r&s&s&x\\a&p&e&y\end{pmatrix}}^{\text{tr}}}={\begin{pmatrix}t&r&a\\n&s&p\\o&s&e\\d&x&y\end{pmatrix}}\,.$

## TheoremTheorem 26.15 change

Let $K$ denote a field,MDLD/field and let $M$ denote an $n\times n$-matrixMDLD/matrix over $K$. Then
    $\det M=\det {M^{\text{tr}}}\,.$

### Proof

$\Box$
This implies that we can compute the determinant also by expanding with respect to the rows, as the following statement shows.

## CorollaryCreate referencenumber

Let $K$ be a field,MDLD/field and let $M={\left(a_{ij}\right)}_{ij}$ be an $m\times n$-matrixMDLD/matrix over $K$. For $i,j\in \{1,\ldots ,n\}$, let $M_{ij}$ be the matrix which arises from $M$, by leaving out the $i$-th row and the $j$-th column. Then (for $n\geq 2$ and for every fixed $i$ and $j$)
    $\det M=\sum _{i=1}^{n}(-1)^{i+j}a_{ij}\det M_{ij}=\sum _{j=1}^{n}(-1)^{i+j}a_{ij}\det M_{ij}\,.$

### Proof

For $j=1$, the first equation is the recursive definition of the determinant.MDLD/determinant From that statement, the case $i=1$ follows, due to Theorem 26.15 . By exchanging columns and rows, the statement follows in full generality, see Exercise 26.13 .
$\Box$
    The determinant of a linear mapping
Let
    $\varphi \colon V\longrightarrow V$
be a linear mapping from a vector space of dimension $n$ into itself. This is described by a matrix $M\in \operatorname {Mat} _{n}(K)$ with respect to a given basis. We would like to define the determinant of the linear mapping, by the determinant of the matrix. However, we have here the problem whether this is well-defined, since a linear mapping is described by quite different matrices, with respect to different bases. But, because of Corollary 25.9 , when we have two describing matrices $M$ and $N$, and the matrix $B$ for the change of bases, we have the relation $N=BMB^{-1}$. The multiplication theorem for determinants yields then
    $\det N=\det {\left(BMB^{-1}\right)}=(\det B)(\det M){\left(\det B^{-1}\right)}=(\det B){\left(\det B^{-1}\right)}(\det M)=\det M\,,$
so that the following definition is in fact independent of the basis chosen.

## Definition

Let $K$ denote a field,MDLD/field and let $V$ denote a $K$-vector spaceMDLD/vector space of finite dimension. Let
    $\varphi \colon V\longrightarrow V$
be a linear mapping,MDLD/linear mapping which is described by the matrixMDLD/matrix $M$, with respect to a basis.MDLD/basis (vs) Then
    $\det \varphi :=\det M\,$
$\varphi$