Use the dstruct map for implementing HashSet instead, enabling more nothrow and @nogc code. Remove opApply which makes meeting these constraints hard.