OpenCL: Rely on shared (host) memory

Rely on host memory being used for the result buffer in order to make
the “fast” unsafe variant safe (without losing speed).