Pass the correct pointers (device vs host) to the GPU