Do deduplication only once when data are fetched

@karllindmark 
Just going through PRs I realised there are some similarities between sorters and if we could extract 'removeDuplicates' to somewhere we could actually some core sort functionality shareable between unlocks sorters. So here you go, deduplication done once data fetched from battlelog, it happens only once so it is more efficient then original approach