Make sure the app doesn't stay open