Remove now useless IMemory
Another smaller optimization