If self versus others is an irrelevant issue, so too is the question of the individual versus society. The individual good and the social good are in harmony. A society is healthy to the extent that individuals are free to pursue their goals. This freedom is the fundamental social value. It requires that human relationships of all forms be voluntary.
Mutual consent is the defining characteristic of a free society.
People are unfree to the extent that they are forced to do what they would not choose for themselves. As all governmental action is based on using force to this end, it is necessary to limit the scope of government action as much as possible, leaving the scope of individual freedom as broad as possible. Politically, people can exercise their rights however they please, so long as they do not encroach upon the rights of others. Socially, people can choose to what extent they will abide by cultural norms. Economically, people are free to produce and exchange as they see fit, in the spirit of capitalism.