There are multiple files to a shapefile, are these all being deleted?