added ability for continuous crawl and new CSVFileWriter