Store watched map listeners in a HashSet rather than a TreeSet (they are not comparable).