[server][DBClientUser] Free objects in AccessInfoMap when it is freed.

Explicit free sematics may cause a memory leak,
because we are human being.