A group of Somali ministers walked out of a meeting Monday , before a majority voted to return to Somalia but not to the capital , Mogadishu , which the prime minister says is too dangerous .