Add raw buffer access to the arrays, needed for copying to GL

Although perhaps later this would be more suitable as a private member
accessed through friends?