produce message that method switchover occurred
add option to produce testset robust to perturbation