logging downs and sweeping old crawler logs