Handle fast disconnects, fixes #106