Added option to delete duplicate lines
Better estimation of completion times for optimizing (dedups still need work re: time estimates)