Ensure we log caught exceptions.

We may see more noisy exceptions from this, but we can always filter
them out later.