notify after x failures (bug 797927)