Add the machinery for plans to be evicted when they're stale