Don't modify the vertex buffer while encoding it to a stream