Set cleanup batch size to same size of runner

To avoid taking 10 minutes to clean up a queue of 100 actions.