This is not about your change, but let's get rid of the shark.column.partitionSize.mb setting, and all those crazy heuristics to estimate column buffer's size. Let's just use 1MB as the initial size for a column. It is pretty fast to do a mem copy anyway. It would simplify some code.