It doesn't make sense if you want to be able to interpret the resulting features. If it is only to reduce the number of features, by agglomerating the ones correlated with one another, it doesn't really matter if they are heterogeneous, right?