Don't look to me for the definitive answer, because I don't have the knowledge to give a detailed, specific account. But at its basest meanings, perversion in this context implies terms such as corruption, turning away from what is good or right, and debasement. In my experience, wearing clothes that are generally worn by the opposite sex is a far cry from evil. Doing so doesn't inherently cause harm to anyone involved, nor does it violate anything but the loosest interpretation of accepted scriptures. What it does violate, however, is the expected macho male gender role.
All males are familiar with how Real Men are supposed to act.
If you need a refresher, then examine any males in commercials for trucks or beer. A separate set of standards apply to the Real Woman. Any person who violates the Real Man or Real Woman models is subject to harassment from peers, ranging from verbal insults to violence. Those who harass their peers who fall out of line do so because they cling to the impression of Real Men and Real Women to such a degree that they assume that any deviance is unacceptable. The problem is, no matter what overzealously macho males think, not adhering to the male stereotype is not inherently wrong by any means .