How to Ask Your Lender to Get Rid of Your Mortgage Escrow Account. If you want to get rid of your escrow account, call your loan servicer to find out if you qualify for a deletion of the account. You might have to fill out a form, such as an escrow waiver, cancellation, or removal request.