Don't cache the pkey, skip generation if the keyfile exists