Linear Algebra, Matrix as Linear Transformation

Matrix as Linear Transformation

An m×n matrix is a convenient way to represent m vectors in n space. Each row corresponds to a vector in n space.

The rank of a matrix A is the dimension of the subspace spanned by the vectors in A. The rank of the zero matrix is 0.

A square matrix A is singular if its rows are dependent, nonsingular if they are independent. The identity matrix is square and nonsingular, and its rows span every possible vector of length n. In 3 space, x times the first row + y times the second + z times the third yields x,y,z. The matrix spance the entire vector space, and is a basis for that space. The space has n dimensions. Any other nonsingular matrix also contains n independent vectors, and acts as a basis, spanning the entire space. Conversely, a basis has to have n independent rows, and forms a nonsingular matrix.

The m×n matrix A defines a function from m space into n space. If v is a vector in m space, v*A becomes a vector in n space. We will prove that the matrix defines the linear function, and each linear function is implemented as a matrix.

Let the standard coordinate axes act as a basis for m space, the domain. Watch what happens when v is one of these coordinate vectors. Set the j^th entry equal to 1, while all other entries are 0, hence v points along the j^th axis, and represents the j^th coordinate. After matrix multiplication, v*A extracts the j^th row. The j^th coordinate in m space is mapped onto the j^th vector in A, which lives in n space. Since (v+w)*A = v*A+w*A, the function commutes with vector addition. If we multiply v by k on the left, then by A on the right, that's the same as k*(v*A). The function commutes with scalar multiplication, even if r is noncommutative, and is a valid linear transformation. thus the matrix A implements a linear transformation from m space into n space.

Conversely, any linear map from m space into n space is completely defined by its actions on basis elements. We may as well use the coordinate vectors as a basis for m space. Now each linear function is an ordered set of m vectors in n space, the image of the coordinate vectors in m space. These m vectors form a matrix, and matrix multiplication implements the linear function. thus linear functions and matrices correspond 1-1.

If the vector spaces are right modules, the linear function must commute with scaling on the right. Take the transpose of the matrix A, so that the columns hold the m vectors in n space. The function is now A*v, where v is a column vector on the right. Note that (A*v)*k = A*(v*k).

If r is commutative, we have our choice. We can write row vectors, with f(v) = v*A, or column vectors, with f(v) = A*v.

Function Composition

If two matrices,A and B, represent linear functions that can be applied in sequence, i.e. the range of A is the domain of B, then the composition of these two functions acts on the vector v through v*A*B. (The * operator is matrix multiplication as usual.) We already proved matrix multiplication is associative, thus the action is also given by v*(A*B). The composition of two linear functions is given by the product of their matrices.

If you're multiplying by v on the right, the composition of A and B is implemented as B*A.