Experimenting with BufferAttribute.
This approach prettifies the API a bit, and the performance seems to be on par with raw access to the typedarray.
Updated builds.