files are local directory, treat them as such when searching

No idea why this changed from using ls, however if we are going to use it make sure to actually remove data and config dirs from remove list