The reason this was included was because new tests were added to the benchmark that shouldn't be run by default as they timeout and crash on the larger documents, requiring more flexible configuration options to be added. Usually I would split it out, but as the changes weren't that large or related to WebODF core, it seemed like a reasonable thing to bundle into this.