Streaming output from closed runner shows a warning now

Addresses #853