added debug flag to userCrawl, to control logging behavior