Summary of Matrix Decompositions#
Here is a comparison of the key matrix decompositions related to eigenvalues and singular values.
Decomposition |
Requirements for Existence |
Components & Properties |
Interpretation & Applications |
Relation to Others |
---|---|---|---|---|
Schur Decomposition |
Exists for any square complex matrix \(A\). |
Q: Unitary (\(Q^H Q = I\)). |
Interpretation: Any linear transformation is unitarily similar to a triangular one. |
This is the general form from which eigendecomposition is a special case. |
Real Schur Decomposition |
Exists for any square real matrix \(A\). |
Q: Real orthogonal (\(Q^T Q = I\)). |
Interpretation: Represents any real transformation in a basis that makes it “as triangular as possible” using only real numbers. |
The real-valued equivalent of the complex Schur decomposition. |
Eigendecomposition |
Exists only for diagonalizable matrices (those with \(n\) linearly independent eigenvectors). |
X: Invertible matrix whose columns are the eigenvectors. |
Interpretation: The transformation is a pure scaling along the eigenvector axes. Associated with “Time” and the evolution of dynamical systems (\(A^k\)). |
A special case of the Schur decomposition where the triangular matrix \(T\) is diagonal. |
Unitary Diagonalization |
Exists only for normal matrices (\(A A^H = A^H A\)). |
Q: Unitary matrix whose columns are an orthonormal basis of eigenvectors. |
Interpretation: The transformation is a pure scaling along a set of orthogonal axes. |
The ideal form of both the Schur and eigendecomposition. Occurs when the matrix is normal. |
Singular Value Decomposition (SVD) |
Exists for any \(m \times n\) matrix \(A\), real or complex. |
U: Unitary/Orthogonal matrix (\(m \times m\)) of left singular vectors. |
Interpretation: Decomposes any transformation into rotation, scaling, and another rotation. Associated with “Space” and the geometry of the transformation. |
Generalizes eigendecomposition to any matrix. The singular values of A are the square roots of the eigenvalues of \(A^T A\) and \(A A^T\). |