Consolidate log data - these data are not used for calculations only logging during crawling