Add a way to opt-out of the exception handling.

[ ] Add a configuration to opt-out of the exception handling
[ ] Test that it's working as it should
[ ] Add documentation for this feature.