Added crawling to the webui using sockets