rules: using del on config cause breakage

If we suppress the call to del, the first commit happens cleanly.
This is not the case with it.