Add a dry-run capability to test runs without sending emails, use logging to report errors so Sentry can pick them up

Reviewers: cramer

Reviewed By: cramer

Maniphest Tasks: T16734

Differential Revision: https://tails.corp.dropbox.com/D64764