added remove duplicates feature (especially handy for deviantart)