South Korean Foreign Minister Ban Ki-moon said Wednesday he had called off a trip to Japan , saying the visit would not be " appropriate . "