Voice allocator space reuse