A flexible web crawler based on Scrapy for fetching most of Ajax(js rendered) or other other various types of web pages. Easy to use: You just need to write a config file and run.