made some changes to the crawler tasks and added a note in celeryconf