Correctly tell plugman which object in config to remove