urlselect: added option to ignore duplicates and alternate url matching

- added option ignore_duplicate
- added use_simple_matching option. when enabled, script will use simple
  string.find when collecting url. when disabled, additional delimiters
  at the end of matched urls will also detected and removed.