Fix spurious notifications during provisioning (CO-937)