move reference counting classes out of server manager and more tests for concurrency