Can we log a warning here that we're trying to delete a directory that doesn't exist?