Use the pkg-config file to determine our LDFLAGS

Instead of adding them in two places, let's use libgit2's pc file to
know what we should link against.

This includes an update to the libgit2 commit where this works on OSX