In 1592 Hideyoshi ordered that Tachibana Muneshige and Tachibana Naotsugu participate of the Invasion to the Korea under the command of Kobayakawa Takakage. Hideyoshi built Nagoya castle as a base to launch attacks on Korea. The castle was relatively close to Ginchiyo's residence in Hizen Province, it is said that Hideyoshi invited Ginchiyo to visit the castle several times when her husband was away. However, when Hideyoshi saw Ginchiyo with her armed women, he left fearing her personality.