stream.segmented: Handle interrupted .wait() calls better.

Previously the worker thread would continue to do
stuff after a interrupted .wait(), causing it to
slow down .close() unnecessarily.