performance improvments for full data load