updated crawler and tested