The flag flying above the tower is supposed to indicate whether the Queen is in residence.