You need to look at your deed and to see what it says as to the homeowners association matter.  Some deeds have various mandatory restrictions calling for the formation and for the joining of the associations.  If it is not mandatory then you can opt out.  But if it is mandatory then you may have no real choice here.  I would have a real estate attorney take a look at your deed and I might ask about the use of a management company to run the association.  See if the rules allow the delegation of the duty.  They may not and there may be a way to get rid of the vindictive management company all together.  Good luck.