Add freeing of neighborhood malloced memory