Send email notifications within the promise chain

Fixup for the previous commit. It was way too annoying in the test when
it failed as it didn't break the test when it broke...