Questions tagged [eigenvalues-eigenvectors]

Eigenvalues are numbers associated to a linear operator from a vector space $V$ to itself: $\lambda$ is an eigenvalue of $T\colon V\to V$ if the map $x\mapsto \lambda x-Tx$ is not injective. An eigenvector corresponding to $\lambda$ is a non-trivial solution to $\lambda x - Tx = 0$.

A linear operator from a vector space $V$ to itself may well not have eigenvalues. That's the case, for instance, when $V=\mathbb{R}^2$ and $T(x,y)=(-y,x)$. However, if $V$ is a finite-dimensional complex vector space, then every linear map from $V$ into itself has one eigenvalue, at least.

The eigenvalues of a linear map $T$ from a finite-dimensional vector space into itself are the roots of the characteristic polynomial of $T$.

If $V$ is a vector space and if $T\colon V\to V$ is a linear map, then $T$ is diagonalizable if and only if there is a basis of $V$ such that each of its elements is an eigenvector of $T$.

14640 questions
372
votes
11 answers

What is the importance of eigenvalues/eigenvectors?

What is the importance of eigenvalues/eigenvectors?
272
votes
6 answers

Eigenvectors of real symmetric matrices are orthogonal

Can someone point me to a paper, or show here, why symmetric matrices have orthogonal eigenvectors? In particular, I'd like to see proof that for a symmetric matrix $A$ there exists decomposition $A = Q\Lambda Q^{-1} = Q\Lambda Q^{T}$ where…
256
votes
8 answers

Proof that the trace of a matrix is the sum of its eigenvalues

I have looked extensively for a proof on the internet but all of them were too obscure. I would appreciate if someone could lay out a simple proof for this important result. Thank you.
220
votes
8 answers

Intuitively, what is the difference between Eigendecomposition and Singular Value Decomposition?

I'm trying to intuitively understand the difference between SVD and eigendecomposition. From my understanding, eigendecomposition seeks to describe a linear transformation as a sequence of three basic operations ( $P^{-1}DP$ ) on a vector: Rotation…
210
votes
7 answers

How to intuitively understand eigenvalue and eigenvector?

I’m learning multivariate analysis and I have learnt linear algebra for two semesters when I was a freshman. Eigenvalues and eigenvectors are easy to calculate and the concept is not difficult to understand. I found that there are many applications…
Jill Clover
  • 4,977
  • 10
  • 34
  • 50
196
votes
7 answers

What is the difference between "singular value" and "eigenvalue"?

I am trying to prove some statements about singular value decomposition, but I am not sure what the difference between singular value and eigenvalue is. Is "singular value" just another name for eigenvalue?
168
votes
3 answers

Why is the eigenvector of a covariance matrix equal to a principal component?

If I have a covariance matrix for a data set and I multiply it times one of it's eigenvectors. Let's say the eigenvector with the highest eigenvalue. The result is the eigenvector or a scaled version of the eigenvector. What does this really tell…
162
votes
7 answers

Show that the determinant of $A$ is equal to the product of its eigenvalues

Show that the determinant of a matrix $A$ is equal to the product of its eigenvalues $\lambda_i$. So I'm having a tough time figuring this one out. I know that I have to work with the characteristic polynomial of the matrix $\det(A-\lambda I)$. But,…
149
votes
0 answers

Probability for an $n\times n$ matrix to have only real eigenvalues

Let $A$ be an $n\times n$ random matrix where every entry is i.i.d. and uniformly distributed on $[0,1]$ . What is the probability that $A$ has only real eigenvalues? The answer cannot be $0$ or $1$ , since the set of matrices with distinct real…
136
votes
8 answers

How to prove that eigenvectors from different eigenvalues are linearly independent

How can I prove that if I have $n$ eigenvectors from different eigenvalues, they are all linearly independent?
Corey L.
  • 1,379
103
votes
4 answers

Are the eigenvalues of $AB$ equal to the eigenvalues of $BA$?

First of all, am I being crazy in thinking that if $\lambda$ is an eigenvalue of $AB$, where $A$ and $B$ are both $N \times N$ matrices (not necessarily invertible), then $\lambda$ is also an eigenvalue of $BA$? If it's not true, then under what…
99
votes
2 answers

What is the relation between rank of a matrix, its eigenvalues and eigenvectors

I am quite confused about this. I know that zero eigenvalue means that null space has non zero dimension. And that the rank of matrix is not the whole space. But is the number of distinct eigenvalues ( thus independent eigenvectos ) is the rank of…
94
votes
6 answers

Geometric interpretation for complex eigenvectors of a 2×2 rotation matrix

The rotation matrix $$\pmatrix{ \cos \theta & \sin \theta \\ -\sin \theta & \cos \theta}$$ has complex eigenvalues $\{e^{\pm i\theta}\}$ corresponding to eigenvectors $\pmatrix{1 \\i}$ and $\pmatrix{1 \\ -i}$. The real eigenvector of a 3d rotation…
89
votes
5 answers

Are all eigenvectors, of any matrix, always orthogonal?

I have a very simple question that can be stated without any proof. Are all eigenvectors, of any matrix, always orthogonal? I am trying to understand principal components and it is crucial for me to see the basis of eigenvectors.
Bober02
  • 2,604
  • 3
  • 19
  • 16
84
votes
3 answers

Eigenvalues of the rank one matrix $uv^T$

Suppose $A=uv^T$ where $u$ and $v$ are non-zero column vectors in ${\mathbb R}^n$, $n\geq 3$. $\lambda=0$ is an eigenvalue of $A$ since $A$ is not of full rank. $\lambda=v^Tu$ is also an eigenvalue of $A$ since $$Au = (uv^T)u=u(v^Tu)=(v^Tu)u.$$ Here…
1
2 3
…
99 100