Some elites are based on nothing more than bank balances or parentage. Others are firmly based on intelligence, wisdom, commitment and ethical stance of their members. I have no problem with the concept of elites. Not everyone has the desire or capability to belong to every group. The problem lies with the qualification for membership, not with the concept.
Hierarchy has an even nastier reputation.
Yet in all societies, regardless of size, structure of purpose, have a hierarchy. Leadership roles exists and will be filled by those who can fill them. Leaders are necessary to achieve the goals of the group, regardless of how that leadership manifests. It is only when a hierarchy becomes closed and fixed that the structure becomes abusive. The concerns of those who dislike the concept of hierarchy due to experience of its abuses are valid.