Eventually, Ulfric will order the player to help take Whiterun. After doing this, the Jarl, his stewards, and housecarls will flee to Solitude, wherein they can be found in the basement of the Blue Palace.