The Fed late last year pledged to back the housing agencies no matter how big their losses , alleviating concerns that the Fannie and Freddie would have to unload mortgages from their portfolios onto the market .