test framework output changes