If you lead any kind of alternative lifestyle, you will be left blessedly alone, rather than being ostracized, but you won't find much in the way of an affinity culture.
If you do what you want you will be fine.