add new options: eliminate duplicates files
code cleanup