Remove guard for getting local memory pointer