You may wonder whether you must pay taxes on the money you receive through a cash-out refinance. However, the answer is no. Since it is a loan from your lender, the IRS doesn't consider the cash you receive as taxable income.