That is up to your call because whether duplicates must be removed or not because maybe duplicate files are necessary for your database or are just blocking other files; hence, decide according to your purpose.