added removing duplicates while inserting to the spreadshit