Implement stream-based PointBuffer constructor and byte fetching #604