Notify users on CI failure
Only ran discovery tests when specifically asked for it