Millay wrote, ‘Oh, oh, you will be sorry for that word!’ in order to convey the experience of innumerable women during her lifetime and in the years before and after her. The speaker is living a life that’s shared by far too many women, and Millay was likely hoping to show how another type of life is possible.