Remove benchmark option in the executable.