Hōjō clan
After the death of Dōkan, the castle became one of strongholds of the Uesugi clan, who fell to the Later Hōjō clan at the battle of Takanawahara in 1524, during the expansion of their rule over the Kantō area. When the Hōjō clan was finally defeated by Toyotomi Hideyoshi in 1590, the Kanto area was given to rule to Toyotomi's senior officer Tokugawa Ieyasu, who took his residence in Edo.