Do not account for not local ips with rate_abusers. Fixes #2909 and Ticket #2822