Occam's razor
It can be argued that the criterion "hard to vary" is closely related to Occam's razor: both imply logical consistency and a minimum of assumptions.