bug fix for crawler