Use the pkg-config file to determine our LDFLAGS

Instead of adding them in two places, let's use libgit2's pc file to
know what we should link against.