Simple hash set implementation, optimizing for heap pointer keys.