Add a way to opt-out of the exception handling.

- [x] Add a configuration to opt-out of the exception handling
- [x] Test that it's working as it should
- [x] Add documentation for this feature.