Only try to logout server on valid session