Ensure plain text rsa keys are really removed