Since the cash you take out through a cash-out refinance is a loan, it is not considered income by the IRS.