Add comments for clarification in crawler
Fix doc
Merge branch 'crawler' into develop