You generally need at least a 640 to do a cash-out refinance, but each mortgage lender sets its own rules.