Rather than only enlarging, watch for persistence.

If the game keeps using something at a new size, we know it's time to make
some adjustments.