more parallellisation and error correction in setup_data_paths