add reporting options and new manifest specific tests