More UI tweaks

Added checkbox to close the progress dialog automatically
Removed the nesting with the 'open replay' submenu