Load the RSA key just before it's needed.

This fixes auth problems when connecting to a server after playing locally.