Portfolio loans can’t be sold to Fannie Mae and Freddie Mac, so, in order to make a profit, they generally charge higher interest rates than conforming mortgages. Portfolio loan rates vary by lender and mortgage type, but they are usually at least 1% higher than market rates.