Enlarge buffer only if requested size is > than current size

This makes the buffer grow 20% fewer than before.