automatically retry connect with allow_agent=False

This seems to be a common reason a connect failure happens.
Explicitly trying again with allow_agent=False may make it work.

Change-Id: If14a9f9eb0d6f707e4f939cb96ab5f6c4844a541