BZ-1016689 - Test Scenario: new rules are ignored until refresh

(cherry picked from commit 07c7fa0ec0635857ad69eb637da8afa0a57f2ca1)
BZ-1016689 - Test Scenario: new rules are ignored until refresh

(cherry picked from commit b21fbfda76243638cf4ea95d7f48a1b713592828)