Close down channels that we open in RpcServer
Merge pull request #1 from justinsb/clean_cleanup

Close down channels that we open in RpcServer