Create an alert dispatcher with cancellation

Move to `runserver()`