Make raising signal exceptions a configurable option

Idea credit goes to @nevinera