Create an alert dispatcher with cancellation