severely optimised memory usage during master data upload