Just use `ImmutableSet.builder()` - I was wrong about it not liking duplicates.