- split up processing step into separate functions for easier isolated testing. Generate recent download only for the last 7 days