Allow revoking tasks which are waiting to be retried