Only ban if the ip hasn't been banned yet