Log permanent failures as critical.

And include exc_info too allow handlers like Sentry to display traceback.