Delete files that should not be tracked now.