little logic error in crawler behaviour