The Japanese are very sensitive to place and appropriate behaviour in respect of that place. Behaviour that is acceptable in one location is unacceptable in another. In side the work place one is encouraged to behave in a highly respectful manner towards one's boss. But as soon as the one moves to the pub the manner of behaviour is likely to change radically to the extent that the distinction between boss and worker may dissolve. Rules are place bound.
More extreme examples are the Japanese tolerance of red-light districts and crime syndicates.
If the brothel is a certain part of town then it is acceptable. The burakumin are said to be outcast because of their involvement with the slaughter of livestock and treatment of leather and other activities considered impure by Japanese Buddhism. They are also impure by virtue of where they come from. They come from the impure place. Sumo, the national sport of Japan, consists of a battle to defend a space, which is sacred.