ipc_glue: Remove connection unref with no matching reference.

We don't reference the connection object on creation, so there
is on reason to dereference it on disconnect.