Remove RPC::Server into the socket server

Since the socket server spins up workers to handle requests, it doesn't
need to include the server module.