Usually not. In most cases, you are the only person who has the authority to change or revoke your power of attorney. Generally, you can change your power of attorney without needing outside consent.
However, there are limited circumstances when a court can override a principal’s power of attorney. This usually occurs when an agent is not acting in the principal’s best interest, and the principal is unaware because of incompetence or incapacity. In this situation, family members of the principal can petition a court to remove the agent or revoke the power of attorney.