XIA/U4ID: simplify local_free_u4id()

This patch makes it clear that there shouldn't be any code path
that frees a local U4ID entry without a listening socket.