Fix ratelimiter not being properly started/stopped on rehash.