Remove memory manager

- Not needed. Sounded hard.