Avoid POCL_MEM_FREE when there is no pointer variable in l-value

used to segfault on android otherwise
android build is fine now