Realized why the output_dir change isnt trivial :(