Feels weird to delete the dir you are current chdir'ed to (but maybe ok?). Maybe skip the chdir