Question: linearly independent eigenvectors are orthogonal?
Answer: In general, for any matrix, the eigenvectors are NOT always orthogonal. But for a special type of matrix, symmetric matrix, the eigenvalues are always real and the corresponding eigenvectors are always orthogonal. ... The PCA is applied on this symmetric matrix, so the eigenvectors are guaranteed to be orthogonal.