Allow closing dialog that's run more than once