Ip allocator refactoring

We don't need ordered set anymore, also some cleanings and simple
benchmark.