more work on data consolidation