This allows files to be processed individually, and only updathose files missing weather data, normalization, etc.