Don't add to wildignore if empty .gitignore