Adding documentation for the crawler and dataset crawler