Retry fake notify task correctly (bug 935185)