Ignore errors for directories we symlink