Don't fetch files that we're going to ignore.

This was suggested on the [mailing list](https://groups.google.com/forum/#!topic/git-tfs-dev/zCR4prIVSPA).