For there is one God and one mediator between God and men, the man Christ Jesus. The church structure of men changed this equation which made people accountable to the authority of the clergy. Let all things be done unto edifying. However, the church structure created by men eroded this basic freedom and elevated certain people to unequal levels of authority. We take for granted this basic system among all our various denominations today.
People can choose a highly structured group or a loosely structured one.
This is because whoever is in an elevated position can also control and influence doctrine. The natural mediating factor of diverse views equally expressed is replaced by a central authority dictating its views to the masses. Because of these imbalances, and the resultant abuses of power that can occur, people simply can be abused by other people in power. This is the Gentile form of leadership Christ warned Christians against using. But Jesus called them to him, and said unto them.