Closes #18: Only 1 dispatcher should alert!

We've been creating an alerting lock, but forgot to use it. This commit
forces dispatcher to check its alerting status before sending them.