Interesting question. This can be done by making special POAs. With such a POA, you can assign only specific and relevant powers to your attorney and restrict his/her powers only to certain situations/transactions. This way, you can avoid misuse of your power of attorney by the agent/attorney.