Added option for setting number of days to keep the generated spider file