I think it makes more sense to move validation from object construction to loading the objects as `RSA*Key`s.

Since that's when you'd get an error if you just had some other format with unsafe or invalid parameters in it.