Yes, the trust documents should outline your ability to remove and replace a trustee who fails to properly fulfill their duties or acts against your wishes.