remove duplicated fields in csv, more tests