Allow cancellation of stuck batches

/cc @myronmarston