Further localize closed conn pull conn return

I only need to do this in the healthy case, as that's the only place a
panic from a send to a closed channel is expected.