Actually set the first_batch flag to false. Apply scaledown only to size, so it can work correctly with with_at_most()