twitter/twemproxy — pull request #234 by eleusive (2014-06-24 03:00:12+00:00)
Title: increase maximum mbuf size

We've been trying out nutcracker at Twitch for a couple months now, and one use case we have is using nutcracker/redis to power a storage system which stores temporal chat room membership info (100K's of users). One part of our data flow involves periodically sending redis large batches (hundreds of kilobytes) of single-fragment requests in the form of HMSET operations (we also do large HMGET operations). We have a small fixed-size connection pool from our client to nutcracker, and a relatively small number of connections between each nutcracker and redis instance.

In my use case I'd like a much larger mbuf size, since I have a good idea of how my requests are shaped and I know I'll have few connections. In general I feel that the user should be responsible for choosing an appropriate mbuf size for their use case, and so I would like to see a much higher maximum mbuf_size. What are your thoughts?