added the option to mark an entry as duplicate - the script will not generate an error for such entries