pack crawler functions into a crawler class
make it work