cleanup of dir
Added check for failed queries
Added CDC crawl data
Added support for multiple FTP methods and changed script a bit