Hōjō clan
During the Kamakura and Muromachi period, Niirayama was the site of a castle belonging to the Hōjō clan, and the later Hōjō clan. During the Edo period, it was the location of the "daikansho" offices of the Tokugawa shogunate controlling Izu Province.