Bananas are native to hot climates, so genetically they’re not used to cold temperatures. The cooler temperatures inhibit the ripening process. While storing your bananas in the fridge won’t damage the actual fruit, it does cause the skins to turn brown faster as ice crystals form in the skin cells.