revamp upload process to use batch infile transactions
untrack data directory