adds cloud, ability to add websites and more improvements on the crawling