only call switchOpenCLDevice only once

Change-Id: Id926b139b14ee667ce4ac0674a3c090b52680649