Yes, if an agent misuses their authority or acts outside the scope of the POA, they may face legal consequences, including liability for any damages caused.