[COOK-4140] Only notify when a rule is actually added

Signed-off-by: Sean OMeara <someara@opscode.com>