The answer is, again, anarchy. It is not a basic human right to sleep with or live with white people. Again, you are right. If it was a human right to sleep with white people, then any white person who refused to sleep with me would be violating my rights. What such a right would justify would be the sexual slavery of all white people, and, since slavery cannot be justified, no right to sleep with anyone can be justified.
Every human being has the right to live.
Every human being has the right to freedom of speech and peaceful assembly. Surely such a right implies that I am obliged not to punch him in the face whether I like it or not. Thats why there is no right to health care or an education. If there were a right to an education, then any teacher who refuse to work would be violating people's rights. A right to an education would oblige teachers to work whether they liked it or not, because rights are obligations.