Delete a setting properly