Fixed issue with crawler after refractoring