Add fake "runtime" folder to the path