BZ-1016689 - Test Scenario: new rules are ignored until refresh

(cherry picked from commit ef64826fafe264930bec88a866658d2aa4760aae)
BZ-1016689 - Test Scenario: new rules are ignored until refresh

(cherry picked from commit 162d567177cf1e53c98a7a58c73c7784268f790d)