Don't catch all and any errors for retrying batches.

In particular a non existing table or column shouldn't be considered as
an error we can just retry upon receiving.