release accept mutex after removing an acceptor