Add smoketests for semiauto
Remove unnecessary imports
Generalize timeout
Move app close to cleanup, and close any living instances on setup