Added duplicate file removal routine.

Added the duplicate file removal routine.