Get rid of files that should not be tracked.