Covariance functions actually do different things based on whether we're calculating self-variances or cross-variances.