Question: are all covariance matrices positive definite?
Answer: Because the covariance of the i-th random variable with itself is simply that random variable's variance, each element on the principal diagonal of the covariance matrix is the variance of one of the random variables. ... Also, every covariance matrix is positive semi-definite.