separated off pre-processing code
ignore intermediate data products too