created work scheduler to schedules run times for crawlers and refresher to minise overlapping runs and memory usage