The gender dysphoric is judged by the world at large, even by his or her peers. The prurient and the inquisitive feel it is quite reasonable to demand the answer to incredibly personal questions. The TS is put under the microscope in a way few other women or men experience. Confusion about the terminology only fuels this effect. I and a few other lesbians, and feminists, would feel like sharpening their scissors at that sort of patriarchal phallocratic attitude.
Public attitudes are even more confused.
The Tort of Labels Labelling people helps if is towards identifying a course of treatment or management, but it stigmatizes people, and can create a group target. Difference is seen as a threat rather than a delight or a challenge. You can not catch blackness or fatness or gender dysphoria. Look for black or white, male or female, man or woman, gay or straight. It is easy to take sides and only see issues.