Throttle reconnection to at most once per 5 seconds.

This will be released as v1.12