Scrapy bot to traverse Drupal sites