Close remote handles when closing stream.