use django-crawler rather than localcrawler for development