Use native HashSet

No reason not to use the native one. It actually seems more efficient as well for our use.