Accidently left some very slow copyToHost in the batching code, removing it makes it faster :-)