If you want to remove someone, and you can still think clearly, you can do so. You can also pick someone new by making another Power of Attorney or adding rules to the first one.