Use the time spent to trigger round time calculation.

This make the load get ballenced faster when there is a fast drop in the usage.