The castle burnt down from a fire in 1837, with parts of it rebuilt in 1839. The castle was burnt down intentionally in 1866 by retreating Kokura troops during its skirmish against the Chōshū clan during the Second Chōshū expedition.