Human rights groups say the defectors are seeking refuge from the hunger and repression in their homeland .