Fixed bug in dismissing rerun failure notification