Speed up SslStream initialization a bit