Web crawler that load sites to hadoop