Bugfix: Fix integration tests from pull request #98 (issue #97)

We no longer raise exceptions out of the execute() method.
More integration test fixes
Merge pull request #101 from Nextdoor/fix_issue_97_integration_tests

Bugfix: Fix integration tests from pull request #98 (issue #97)