Fix missing memory include.
The great allocator move.

Everything at this point should be using a custom allocator or the default
allocator provided by the library.

I should probably add a set-default-allocator method.
Add a function to change the default allocator.