Remove unused RPCServer.

Not called anywhere...

Reviewer: @scottschurr @nbougalis