These people are in no way less important or less equal than anybody else. While many people seem to fit one of two sexes, do not discount the many intersexual people. At the central point of our imagined figure is the beautiful, perfectly proportioned, healthy, fertile, heterosexual, athletic, white, Anglo-Saxon person. East Asian women are often eroticized as objects, not people. Anything that causes society to see you as a less-perfect version of your gender pulls you away from the central point.
Some people choose to identify with that point in space.
That is fine. Others do not. That should be fine, as well. Unfortunately, society does not see it that way. A perfect example.