Fix bug where we show ultimate and penultimate dialogs at same time

[#62185294]