If you take out an FHA or USDA-backed loan, or if you're paying delinquent property taxes with cash from a cash-out refinance, you'll almost certainly have to escrow your taxes and insurance. With a 20% down payment, conventional lenders will usually eliminate the escrow requirement.