He only went back to Japan once , and that was to marry his wife .
He returned to Japan only once , to marry his wife .