ability to re-run notifier test

git-svn-id: https://svn.apache.org/repos/asf/continuum/branches/CONTINUUM-2713@1548070 13f79535-47bb-0310-9956-ffa450edef68