Don't allocate Kryo buffers unless needed