Galaxy-673 - Replaced an array with a proper set to ensure no
duplication, through set mechanics, and now make urls sane before
adding them to the set, to ensure no stray characters make the url the
"same" but different in the eyes of duplication checking