Optimize response buffer handling.

We weren't using pooled buffers, and we were eagerly allocating buffers which might not have ever been used.