No problem, you could return the same dummy RestCallLimiter every time.  For that matter, you don't clean up all the existing RestCallLimiter instances when the limits are changed to 0.