More than 100,000 North Korean refugees are likely to flee to Japan if a crisis hits the Korean Peninsula, well beyond Japan's capacity to deal with such an influx, a Japanese newspaper reported on Friday.