Physics.
Provide a well-known location for SSH_AUTH_SOCK.
Be optimistic and try to SendEnv prompt vars.