Cleanup of the gaiohttp worker

Also add support for unix sockets, without the need to use
self.loop.create_unix_server