I think it would work just fine. I would mash them a bit with a fork or in the food processor first though. It doesn't need to be a puree you can have some texture but mashing will help holding the loaf together.