Properly handle outstanding requests on disconnect