Make xs parameter in InferSeq internally use a set