A fairly tested version of my crawler