Minimize buffer allocation as it is expensive if no pooled buffers are used