moving functions from runScraper to finDataImport