avoid sending empty fields, remove dupes