Setting the real given size not the aligned size to the buffer when resize it