Cleanup workers even if they didn't contribute

This avoids the possibility that a worker initializes a stream late and eventually times out.

It's a more heavyweight and more complete alternative / complement to cloudant/rexi#19

BugzID: 24507