Add a close window test for the conversation window

This adds a close window test option for testing the conversation window being closed.

This should lead into future PRs for being able to have less browser restarts during the tests.

Suggest review from @dmose