Grow buffer instead of using a tmp slice