Can we skip this addressing part here by directly storing the values as pointers in the set?