Only ban if trying to connect within 0.5 seconds