If we change this to just `benchmark/suite-run` and also fix paths in other places, can we get it to work with just adding `lib` to `$LOAD_PATH`?