Delete the directory instead of the file