Keep vertex arrays in sync

If a colour buffer already exists and more vertices are added, it is now
extended properly