Core: minor memory releases on server exit

Signed-off-by: Eduardo Silva <eduardo@monkey.io>