Avoid excessive timer usage to throttle clients.

With this change I have virtually no CPU load with 20k connected clients.