load the csv file and analys and remove the duplicates