Simplifies connection ref counting without changing behavior
Simplify internal ipcs ref counting, add comments and document api behavior