preload the public keys for allowed users to allow immediate connection