Updates for getting data via pipelines. Changed get_dir's to both call the same core function