Yes, you can give written permission to other people (for example, a family member or trusted friend) to deal with issues on your behalf.
Check what paperwork is needed for the agency you want the person to be able to deal with. For example, Work and Income has a special form you have to sign. Many banks have a special form too. Other banks require a power of attorney.