Just remove the rule rather than flushing all rules