Remove files that no longer exist from ignore