Validation to prevent duplicated files being downloaded.
Optimized data processing,
Web call to process files.
Refactored file download to be a part of the data processing.
Removed dead code.