Set a threshold to amortize the time-to-idle cleanup