Remove redundant sort

This speeds up Set creation by about 33%