-Added Checking for duplicates to speed up the process. Files with the same checksum will only be checked once.