Removing sockfds from the hashtable