the estimated sigma2 was not subtracted to the variances of the selected components. It was therefore added twice when adding a diagonal matrix on the cov (see += delta in ProbabilisticPCA.score)

and the heteroscedastic model of ProbabilisticPCA is a hack.

makes sense?