The castle has stood on the hill for centuries watching over the changing city below.