Add support for showing a notification on alert. Issue 3162