Ouch. Good point.  Given that this will be called per invocation, a synchronized LinkedHashSet will be more performant.