Don't use a push back channel, instead just attach any left over bytes to the connection

This prevents copying in the pipelined case