window: Add a configuration window for prompt handling - bit ugly at the moment