add an option to disable requeueing of tests

I'm planning to use this option with violation collector plugin.