Only check on REMOTE_ADDR to allow the sauce proxy pass through