Don't check SSH_CLIENT status on local connections