dont free externally allocated user_space when closing connection

Signed-off-by: Andy Green <andy.green@linaro.org>